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Introduction 

V 




College and university administrators must increasingly confront the problem 
that students withdraw without completing a prescribed com^e of study. Dropping 
out is more and more "being seen as a sign of institUtioM| failure. Preventing 
students from doing so has become a major preoccupation throughout post- 
secondary education. ■ ^ 
. - Many reasons for this preoccupation are apparent. For private institutions, lo§t 
students mean lost tuition revenue. In times of shrinking resources and increased 
competition, every studenj^lost may have a noticeable effect on the institution's 
operating budget (Kemerer, Baldridge, and Green 1982). In the public sector, 
funding has been no less tied to enrollments. Because of this, maintaining enroll- 
ments through increased recruitment and retention has held an escalating level of 
priority. In both types of instit titions, moreover, administrations have discovered 
that the*costs associated .^ith successful retention programs are generally far less 
than the costs associated with recruiting new students. , , 

For any institution, the first step in constructing a successful student-retention- 
program is research. Each college and university must discover (1) the' degree to 
which it has a rete nroblem, (2) the particular student populations among 
which the probleiji u ..ui ring, and (3) some of the reasons why iht problem is 
.occurring! The key to answering these questions lies in development of an eiFective" 
"student-tracking" systern. Such a system, composed of data drawn from ongoing 



student reeofds and the responses to student and former-student surveys, can help 
an institutlQn estimate what kinds of sjtudents are dropping out of what kinds of 
prograifts under what kinds^of circumstances. " , ' 

The pi^i^Bpicof-thlff manual 'is to outline a set of techniques for conducting 
student-attrition studies using the NCHEMS/CoUege Board Student-Outcomes 
Information Service (SOIS). While the explicit applicability of SOIS instruments to 
retention research will bcbdiscussfed in some detail, the manual is also intended to be 
useful as a general guide to conducting student-tracking and retention studies of all 
kinds. Consequently,, as much attention 15 paid to conceptual issues of retention 
research as to the administration of a particular set of assessment instruments. 

Why a Special Manual for Attrition Studies? 

Because many of the techniques presented in*this manual apply tb all types of > 
student surveysC^e miglht question the need for a special manual on conducting ' 
student-attrition studies; Anyone familiar/ with general student-survey practices 
could easily apply these techniques to surveys of former students. However, many 
special' problems arise when trying to survey former students— particularly 
students who may be disillusioned or angry with the institution or the educational 
process in general. Special problems are likely to be encountered in simply'identify- 
ing the students to whom the questionnaire is to be sent. More proWems may be' 
encountered in producing a questionnaire designed explicitly fof'laonreturning 
students and in locating and obtaining responses from a dispersed and possibly 
alienated population. Institutional administrators often -lack the time and the 
. resourcwlrequired, JoJndepe^^ 

methods required for an effective attrition survey. The SOIS system, if coupled 
with a special manual on conducting student-attrition studies, can overcome-many ' 
of these difficulties by providing administrators with a proven set of survey instru- 
ments together with some tested guidelines for ^initiating an effective attrition- 
research effort. 

Furthermore, student attrition can be an extremely complex phenomenon. 
Much research has indicated, for example, that students often make the decision to 
leave an institution long before they act on it, and that many reasons are involved 
(Lenning, Beal, arid^Sauer 1980). More importantly, it is often difficult to isolate 
precisely which elements of the institutional environment were responsible for the 
decision and the degree to which action on the part of institutional administrators 
might have influenced the decision. Thus, another reasons for an explicit manual 
on student attrition is to outline some of the unique challenges of ^conducting 
research on this multifaceted subject. » ' ■ . 



An Overview of SOIS 

The Student-Outcomes Informotion Service (SdlS) was designed jointly by 
NCHEMS and the College Board in the mid-1970s. The purpose of the system is to 
provide college and university administrators with a range of student-outcomes 
data useful for program planning and decisionmaking. Since 1977, more than 120 
higher-education institutions have administered more than 480,000 questionnaire 
instruments under the SOIS system. 

Most of the items included in SOIS questionnaires have been tested indivi- 
dually, either on previous versions of SOIS instruments or on comparable, question- 
naires such as the Bureau of Census Educational Attainment Survey or the 
Cooperative Institutional Research PrOgratn Survey of Entering Freshmen (Astin, 
Panos, and Creager 1967). 

Pilot testing of the initial series of five questionnaires took place in 1977, and as 
new questionnaires are added to the series, each is thoroughly pilot tested at both 
two-year and four-year institutions. The final versions of the currently available 
'series were developed in consultation with field-test users. Institutions using SOIS 
instruments are periodically surveyed to detect problems of wording and adminis- 
tration, and several modifications have been made on the basis of this feedback. 
^' The core of the service consists of six questionnaires designed for adminis- 
tration to students at different points in their enrollment history. Each of the six 
^ questionnaire instruments is offered in a two-year-and a-four-year-version-in order 
to accommodate the special needs of different kinds of institutions. A key feature of 
the questionnaires is that all six contain a common set of core questions, enabling 
direct c9mparisons to be drawn among different populations of students or between 
different points in the college careers of the same body of students. 

SOIS survey instruments have also been designed to allow each institution to 
add up to fifteen questions unique to the institution, system, or state. In this way, 
college and univrersity administrators can collect standardized comparative data 
about their students at the same time that they examine particular institutional or 
statewide problems not addressed by the standard questi^nsl*^ 

An additional feature of SOIS is that the service includes a questionnaire- ' 
.analysis service. The ser\Hce provides detailed analytical reports on the data 
gathered, eliminating the need for local data processing. Furthermorellljomparative 
data from^ther institutions of similar type are provided through program profiles— ' 
standal'dized reports incorporating all institutions using the SOIS Questionnaire- . 
Analysis Service. . ■ ^ , ' 

Particular types of data collected by, each questionnaire in the SOIS series are 
noted below: 



' "' ' 1. Entering-SttiSent Questionnaire. Administered to students as-they first . 
; . "register at the institution, this questlonn 

bh dembgraphid characteristics, kucatibrial and occupational exper- 
;. ' ience'and plans, sources of financial support, goals, and reasons for 
''^lectinglheTristitationTltfcar^ a valuable data supplement to 

- the inforihation routinely coliected. through a^^ 

2. Continuing-Student Questionndire. AdministtTtd to students^ as they 
reenroU each term and to students who reenrofl after beinf^j from 
the institution for a term or more, this instmment collects'^a about 

- - - - student characteristics rand backgrounds as well as information on - 
' students' current and long-range goals; employment status; and need 
. , for, use of, and level ofsatisfaction with the services provided by the 

-■'■■^ college. .^^......■^ ^J-;/ .r 

3. Fomet^Student QMestidhnaire. 
students whbileave the institution With<^ 

gram or receiving^ degr^^ certifeate^In addition to deniogra^^ 
: and background data cohcerningstudents^^^ 
the institutibh, the questionn 
■ . why students did not return (both positive and negative reasons) and 

- , on their level of satisfaetjbn with various institm^^^ 

4. Pn3;fra?M-^ 

fered to all sjudents who are about to complete a program or'earn a 
V degree or certificate, this questiomiaire provides demographics, back- 
ground data,, and information on students' level of satisfaction with 
■ ] various institutional services as well as student ratings of how well the 
institution.helped them reach their goals. Information about students'" 
future educational plans is also cbllected. 
5:Re(mt^Alu^ 

year after a student's completion of a degree, certificate, or. vocational 
. : program, this questionnaire provides demographic and background 
data on students' progress at the institution as well as considerable 
detail about the first degree programs that students enrolled in after 
graduation and the first full-time jobs they held after leaving the 

institution. V :;"r;''\;;;V.:-'^ 'r-.-- 
d. Long-Term Alumni Questionnaire. Administered from three to five 
■.: . years after a student's completion of a degree, certificate, or vocational 
program, this questionnaire, provides demographic and biackground 
. . .. data about students' enrollment at the institution and considerable 
V\ I detail about postgraduate educational and fulHime job experience. 
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. , All six questionnaires in SOIS can be used in sequence to collect longitudinal ' 
; data, , or they can be used separately to collect data about a particular groupVof 
- students or to investigate a specific prbbleni; With periodic administration of the ; 
: questionnaires, an institution can assess the progress of its students and the relatiye 
. impacts u pon studen ts of its_ various educatiMal^ and s eryice program s . Da t a ob- 
, tained from longitudinal outconie studies can be compared to; the results, of 
previous studies of the institution's students, as well as with similar data obtained 
from other institutions using the SOIS que stionn a ires. For a more detailed descrip- 
tion ojf the SOIS system and how it can be used, see the accompanying publication, 
Student-Outcomes Questionnaires: An implementation Handbook^ Second Edition 
(Ewell 1983b). . " 

• ■ ' ' *^ 

• , ■■ \ .... . . . , , ^ 

Overview of the Manual . ■ 

Effective retention research requires more than simple miethodology. Many diffi- 
culties may be avoided by understanding from the outset which of several concepts 
of attrition will he used to guide a particular analysis, and understanding how the 
data on attrition, once collected, are going to be used. This manual is organized to 
provided guidelines on how to do retention research and on how to effectively apply 
the results of such research. 

Chapter 2 of the manual is concerned with better defining student attrition and . 
with presenting a summary of the results of recent research on the reasons^ why . y 
students withdraw frprn college: Am of the chapter is to provide some 

. general concepts to effectiyel3^^ide^^a^ " 

Chapter 3 of th^ manu 
. system built arpiind the kinds of ongoing registry institutions . 

collect routinely. A further^ p^ is to show how SOIS survey - : 

instruments caii considerably enhance such a system by providing longitudinal data ; - 
on student attitudes and achievements. - * 

Chapter;4 of the manual describes in detail techniques for conducting a mailed 
survey to nonretuFning-students-usirig-^the-SOIS-Fop^ 

Such techniques include identifying dropouts, ensuring usable response rates, ' 
estimating; costs, and analyzing 1^ 

Chapter 5, the final chapter, .covers ways of using the results of retention 
: research to design and inforni more effective retention programs . Appendices td the 
manual include a plannihg^^^^^ mailed questionnaires, a g^^^ 

toiisingthe SQIS Questionnaire- All Service, sample reports and coyer letters, - 
and copies pf the SOIS Former-Student Questionnaire in its two-year and four-year : 
versions. ■ ^ 



An Overview of 
Attrition and Retention 



It is often observed that retaining students is not in itself an appropriate goal for^an 
educational institution. There are many reasons, for example, why a given student . ' 
ought not continue to be enrolled in a particular institution ._Amo^^ 
bf academiclk^ the student's, own educa-e 
tional goalsV Although enrollment-driven fimding formulas and lost tuition revenue 
can often foster a short-term, "retentionrat-all-costs"' mentality among college and 
-university administrators, such an attitude is rarely of benefit to an institution in 
the longnm. ' - — - --^ - . - - . - - - z 

Rather than Heing a goal in itself, a high student-retention 
result of the improved programs- and services provided by the institution. The 

; objective of retention programs shouldbe to provide an effective curriculum^ and an 
appropriate array of support services designed to meet the identified needs of* 
currently enrolled and fixture students f A retention-research p^^ conse- 
quently attempt to identify which students stay and which leave, and to ascehain..(.v^^^^^^ 
the degree to which decisions to leave might be preventable through institutional 

:action.- ' - ■ J.-." ■ ■ 



>Se^indicatioh of the^^ retention is the number pf widely^held, 

beliefs Jfbout those who^^d^^ often advanced as reasbhs why stu^^^ 

r leave, none of these belieft tuirris out to be unift)^ ^^^^ Soes 

—wrong, :however,-can^provide-sbmeimportantJ^n^^ intoJthiicompJexnMULe Pf. 
student attrition (Noel 1982). ' 

1. Retaining students means lowering academic standards. This.. belief is 
commonly held by Ibculty, who often see student-retention programs 
as keeping students enrolled. who ought not to be.'In fact, however, 
most research -indicates, little correlation between voluntary with- 
drawal and academic difficulty (Lenning, Beai; and Saner 198U). Most 

students who leave do so in good academic standing, and do • so for 
complex reasons. Pejceived^cademic problems are often some of those 
reasons, but they by no mbans constitute a'majqrity. 

2. Retention is a strident-services proMern.Thishe^ common 
.. and holds that it is up to counselors and .other student-a"frairs^ 

fessionals to prevent students from dropping out. According to this 
" belief, students withdraw because they have not been properly coun- 
seled, advised, entertained, housed, Or fed; in brief, ke^ 
enrolled is not an academic responsibility. On the contrary, however, 
much research has shdwn. t^^^^ 

single most importarit factor involved in student retehtio 
1979). Furthermore, no single office or professional role is critical, 
r Rather, successfiiVstudent-reterii}:^ : T)rbgranis are built on a.soU 

dation of cooperation thr oughou . .fee institution (kenierer, Baldridge, 
and Green 1982^:EwtM^ , 
3/Dropotitsare '}flimkd^ts^"^ pn the first myth emphasize^ 

the comrilon perception that students who withdraw^^c^ 
—^——aGademic-c-halleng€-and ought not to have been enrolled in the first . 
: place. As mentioned previously, there is little evidence that thi^ 
generally" the case. More importantly, this myth places the entire 
• responsibility for student sucfcess on the individual student and none 
on the instimtibn. \l(4iile many w 

research suggests equally many are not and could have been prevented. 

if appropriate action had been taken. - , , . 

A. Dropouts cannot afford to continue. This myth h^^ 

reasons for withdrawal are financial. Students leave because they nin 
' out. offinaricial aid or otherwise find that they cannot pay the tu^ 
* and li ving, expenses associated with college or university enroUment. •* 

While finances are often given by students as a reason for withdrawal, 
the bulk of research, evidence suggests that financial difficulty in itself 



4sa:areLvJLhe cause of drd^^^ 



■ Instead, financial stress may be one amohg many interdependent moti- 
vating factors, but one seen by students as an externally ''ac^ 
reason for leaving school . , 



Persistence of these myths . despite the findings of many years, of retention 
research testifies to both the riiultifaceted nature of student attrition and to the need 
for each institution wishing to improve retention to develop its own retention- 
research program. Such myths are only generally refuted in the context of hard, 
unambiguous data about the fates anH opinions of students enrolled at the institu- 
tion in question. . 



The Many Definitions of Attrition 

Students withdraw from colleges and universities for niany reasons . Distinguishing 
amongjhese reasons is one. of the first tasks facing any attrition study, and it may 
well be the most challenging; At. the simplest leyel, "attrition" is used to describe 
all withdrawal from an institution without formally completing ^ program. Because 
most student record systems are constructed on a term-by-term basis, in practice, 
this means that any student hot completing a program and not enrolled in the 
current term after haying been enrolled.in^a past term is counted as contributing to 
'attrition. A further refinement of the term wiil exclude academic failures; Accord- 
. ing to this conception, attrition; will consist of all those voluntarily "withdrawing 
from an academic program. : • 

While none of these defiinitions of attrition is imrinsically right or wrong, it is 
; important, to identify three problems often associated with the concept of attrition. 
These problems can be labeled the Unit-bf-Analysis Problem, the ''Stop-Out'' 
Problem, and the Goal-Fulfillment^^^^ 

; The essence Unit-of-Ahalyn^ determine exactly Avhat a 

given student is withdrawing froni. Fpr example, ''attrition" can imply withdi-awail 
from a particular course, from a program, froni an institution, or from; higher 
education at large. In the first case, the ^^^^ the course will note'a ■ 

"loss" when the student does not return^ but there haScbeen no loss from the degr^^^ 
program in which the student is enrolled orfrom the institution. In the second case, ' 
a change in enrollment status may produce gains and losses for .several programs at 
the institution, but the net enrollment of the institution will remairi 'uncharigedv^^I^^^^^^ 
the third case, the student will cause an enrollment drop for the institution biit ma^^^^^ 
enroll in another institution in order to more effectively pursue his or lier educa- 
tional goals. Only in the fourth case does withdrawal cause a net loss to the entire 
system of higher education. ^ ^ ^^^^^ y'^ 

Which of these severalconceptions. of attrition one chooses, of cotj^se, depends 
upon where one sits. By far the niost common.is the thirdy because losses to a giv^ 
institution constitute a financial loss regardless of where die student goes. But it is 

' 7 - . " , : ' } [ 
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. important 10 eitiphasizeiliat-there 

■ . attrition at the clasSy progrard, or systfeni^eyeh of anal^^ niany institutions^ ; ( 
"j^Texam^lirrtln^^ 

Students withdraw from important core courses. For ; others,-the ?tructure ^^^^^^ 

^.vblume-ofinterprogram-traMfe^ 
some prograiris must be staffed to meet shifting student demand. Finally, institu-v. 
tions should know whether students are leaving to pursue study elsewhere or 

• because their educational goals haVe already been met. ' 

The essence of the Stop-Out Problem is that more and more students experience 
complex patterns of enrollment that involve not attending college for one or more 
terms. Such interrupted enrollment— often termed "stopping out"— can con- 
siderably complicate the investigation of attrition. This is because the student can 
easily be counted as a dropout during the term he or she is not attending, only to 
drop back in again.the next term. The student's real status has not changed over tlie 
, period of nonenroUinent, but it is extremely difTicult for the researcher to know this 
until the student has reenroUed. As will be discussed in the following chapter, a 
primary reason why institutions undertake student-tracking studies is to enable 
.thein to separate dropouts from stop-outs. \ " 
- The final problem, the Goal-Hilfillment: Problem, is the most conceptually 

C complex . The essence of this problem is that stu4ents withdraw from colleges and 
universities for both positive and negative reasb\is.".S6me cease their enrollment 
because they have fulfilled their ediicational goals, while others withdraw because " 
they feel that the institiition. is nb^^^^ 
motivations result iri the siaihe actip 

and the second is the result of perceived deficiencies in the institution. ; 

Many college and university administrators dp libtv^eco^nize the importance of 
this distinction A student lost is, after all, a student lostj whether or not the student 
has fulfilled his or her own goals is seen as of little consequence, Increasingly, 
however, administrators have come to recognize the value of partitioning gross 
attrition-statistics into a-portion representing real attrition— the part that the insti- 
tution is responsible for and ought to do something about— and various other kinds 
of withdrawal (Sheldon 198 1). Not to do so is to considerably overstate the attrition 
, problem. :For example, many community colleges must increasingly labor under 
the burden of attrition rates of 75 percent or more. Upon investigatiph, niahy of 
those counted as attrition have left the institution to accept employment in their 
field of training— the reason why they chose to enroll in the first place (Nickens 
•'1976i Phillips 1982). Similarly, many community-college transfer students enroll 
and perform successfiiUy- at senior institutions without ever obtaining the. A.A. 
degree. Because they did not obtain the degree, these students are often technically 
counted under attrition although they fully met the goals of the program ia . ^'>tch 

■ they were enrolled. Such problems are not only encountered at community coiieges 
but increasingly are affecting four-year institutions as well. 
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^ : B and univf^rsity adniinistratoirs sHou^ 

. continually bear two points in milid when considering gross attrition sta^^^^^ 

first lis. to carejEuH 'of the students in question^^ 

and^jh^^^ 

; jectives ■ Stud^ for, increasingly diverse reasons, and very few of 

those reasons today inc lude the traditional one of earning a baccalaureate degree . 
Secondly, however, administrators should carefully distinguish between factors 
that the institution c^n control and things thai are outside the institution's capacity 
to influence. As Robert Grose has effectively pointed out, som^e students should 
leave college (Grose 1980). The missio«& of effective research-based retention pro - 
grams is to prevent the ones who shouldn't drop out from doing so for preventable 
reasons. 

In sum, the simple notion of term-to-term attrition becomes complicated vi^pn 
all its ingredients are noted and assessed (see figure 1). A given institution may have 
a relatively high gross attrition rate bul niay do an excellent job of fulfilling student 
goals and of ininimlzing preventable dropouts. Another institution may have a 
much lower gross attrition rate but may be doing a much worse job at keeping the 
students it could and should keep^ Qne of the most important tasks of retention 
research is consequently to enable the administrator distinguish between these 
irnportantly different types of withdrawal. 

Research on Student Attrition: Seine Findings 

.; >XTiile each institution ought to develop its own attrition studies, it is useful to 
consider the many findings that have emerged in retention research over the past 
two decades. Knowledge of these general findings will enable administrators to ; 
focus imniediately on those areas where their student population is similar to or 
diflereht from national trei5ids.\Such knowledge will enable those responsible for 
. developing campus wide retention efforts tQbe«e^ 
programs rhat'have w^^ • V 

A first question is what levels of attrition are typica 
tions: Table 1 gives results^ student-retention rates for different types of insti- 
tutions over difTerent time periods. Thesb statistics consist of average rep 
retention rates supplied " in j-espot^e to a recent survey of stiide^ 
programs conducted by , NGHEM^hd the American Gbllege . Testing Program 
(Beal/.and Noel 1979). Because they^are s^^ 

treated with sbnie caution. Many definitions of retention may be present in the 
numbers reported here. Nevertheless, trends by type 0^^ 
apparent a^^ while not norms, can serve as useful benchmarks in conducting 
institmion-specific researctf on student attrition. l^ -^. . 
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FIGURE 1 
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..TABLE 1 

• Retention And Graduation Rates by Type of Institution 



.1. 0 . ■, ■ 

,Cj:tenUon aHer 1 Year , Retention after 2 Years Graduation" ^ . 





• 1975-76 


1976-77 


1977-78 


1975 


.77. 


1976-78 


In 

in J 


Yrs. 


in S 
in J 


Yrs. 




N 


% 


N 




-~N , 






-% 


-.^N 






% 


. N 


% 


2-Year Public 


81 


57 


92 


57 " 


101 


55 










213 


42 






2-Year Private 


28 


61 


30 


64 


31 


63 










48 


61 






Secular , 


12 


63 


12 


62 


12 


64 










20 


64 






Religious 


16 


60 


18 


65 


19 


62 










28 


60 






4-Year Public 
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68 
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66 . .. 


92 


55 
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54 






148 


53 


4-Year Private 


223- 


71 
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71 


237 


70 . 
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Secular 
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72. 
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72 


, 85 


73 ■ 


60 
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63 
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116 


63 


Religious 


149 


71 


158 


70 


161 


68 


131 


55 
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54 






211 


58 


All 


446 


67 ■ 


479 


. 67 


502 


.65 


286 


56 


280. 


56 






227 


58 



SoC.RCK: Philip E. Beal dnd Lee Noel, Whai Works in Student Retention (Iowa City, Iowa, and Boulder, Colo.: American 
College Testing Program [ACT] and-National Center for Higher Education Management Systerhs [NCHEMS], 1980), 
p.37...- ^ ■ ■ . '"^^ ■ ■ 



A second question is what research can tell us about the kinds of students who 
drop out; As table 2 indicates, the characteristics of the "typical" withdrawing 
student can be summarized in terms of four basic dimensions— academic factors, 
demographic factors/ goals and aspirations, and financial factors (Lenning, Beal, 
and Sauer 1980). Academic factors include such traditional items as aptitude and 
. prior performance; they also include such ''skills" factors as study habits and 
"quality of effort" (Pace' 1979). Demographic factors are generally not powerful in 
predicting or explaining student withdrawal from college, once academic and 
mptiyatiorial factors are taken' into account. Thus, the typically high .withdrawal 
rate of minority students in manyinstitutions are largely explainable in .terms of 
other factors. _ ■ ' 

Goals and aspirations are often powerfiiliy 'rdafed^^^t^^^^^^ 
As discussed previously, the degree to which a student sees attainment of a degree as 
an intrinsic goal to be pursued is an important predictor of program completidrf 
(Walleri 1981). Peer expectations of degree attainment" and 'employment can be 
another powerful influence here. Financial factors, while often overrated, can ' 
nevertheless be important. As discussed previously, however, students often say: / 
they have a financial problem because such a problem is perceived to be a more 
acceptable reason for leaving college than what may be thcreal reason; ^ . 

In examining this list of related characteristics, two cautions.must be borne in 
mind. First, these factors are often complexly interrelated". A student seeking 
employment may h^e a combination of negative peer expectations, for higher- 
education, poor study habits, and a high concern about finances. Another student : 
may have a similar or a different combination— there are few consistent patterns of 



. TABLE 2 
iSuMMARY bF Detention Correlates 



Academic Factors: „, ^ 

High^School Performance (GPA, Rank) + 
Academic Aptitude + 
Poor Study, Habits 
First-Term Grades 
^ Academic Rating of High School 



Demographic Factors: 

Age . 

Sex 

Socio-Economic Status 
Ethnicity 

Siize of High School 

Aspirations and Motivations: 

Level of Degree Aspiration 
. * . Intention to Transfer 
^Commitment 

Peer-gronp Influence 

Vocational Goals 
Satisfactiorf 

Financial Factors: 

Concern about Finances' 
" Financial Aid 
Employment (Full-time) 
Employment (Part-time) 



+ 
+ 



(but many high^otential students drop oyt) 



(but many students leave in good standing) 
(relates primarily to breadth and quality of 
curriculiun) 



+/- 

+/- 
+/- 



(older students tend to drop out of traditional 
curriculiun) ' 

(not in itself a factor but may be related to - . 
others) 

(minority students drop out more frequently, but 
evidence is ambiguous as to why) ' : ' - • 



+/- 



+ 
+ 



(relation is positive if peer group is also 
enrolled) ' * o . 

(positive if a vocational program requires 
certification) 

(but results surprisingly ambiguous)^ 



(but form of aid can influence persistence) 
(especially if on-campus employment) * 



Source: Adapted from findings reported in Oscar T. Lenning, Philip E. Beal, Ken Sauer, Retention and Attrition: Evi4ence.fQr^,^ 
Action and Research:(Bo\i\d&y<^^^ 
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TABLE 3 



Positive Campus Characteristics by Type of Institution • 



Positive 


■ 2«Year 


2. Year 


4-year 


4.Year 




Characteristic ■ 


Public 


Private 


Public 


Private 


Total. 




N =\255 


52 


201 


350 


858 


Caring attitude of faculty and staff 


4.30- 


-4.52- 


-4,00- 


-4.38 


4.28 


High quality of teaching 


4.03 


2.67 


3.72- 


3.94 


3.91 


Adequate financial aid 


3.79 


3.56 


3.77 


. 3.51 


3.66 


Student involvement in campus 


3.03 


3.46 


3.46 


3.44 


3.30 


High quality of advising 


3.46 


3.30 


3.19 


3.09 


3.23 


Excellent counseling, services 


3.56 


3.06 


3.18 


2.94 f 


3.19 


Excellent gar-eer-planning services 


3.37 


2.80 


3.21 


. 2.99- ^ 


*3.14 


Concern for student/institutional fit 


2.88 


3.36 


3.01 


3.30 


'3.11 


• Admissions geared to graduation 


2.54 " 


3.19 


• 3.06 


3.r4 


2.96. 


Early alert system . 


2.75 


2.90 


3.70 


2.61 


2.70 



Note: Figures arc average ratings given by respondents on a scale of one (low) to five (high). 



Negative CAMPuTeHARACTERisTics by Type of Institution 



Negative* 


2.Year 


2.Yw^ 


^4^ear 


4- Year 




Characteristic a 


FubUc 


Private 


Public!^ 


Private 


Total 


i N = 


255 


52 


201 


"350^ 


858 


Inadequate academic advising 


2.87 


2.33 


.3.61 


2.90\ 




Inadequate curricular offerings 


2.65 


2. 56 


2.90' 


2' 93 


2.80^ 


Conflict between class/ job 


3.78 


2.12 


2.86 


2.08 


2.77 


Inadequate flnancial aid . ^ 


2.40 


'2.50\. 


2.64 


2.91 


2;66 


Inadequate counseling support system 


2.53 


2.29 


2.76 


■ 2^56 


2.58- 


Inadequate extracurricular programs 


2.47 


2.86 


2.31 " 


; 2.78 


2.58 


Inadequate academic support services 


2.40 


-2.10 


; 2.80 


2.52 


2.52 


. Inadequate cultural/social growth 


2.42 


^2;14 


2.52 


2,61 


2.51 


Inadequate career-planning service's' 


2.58 


2,20 


2.74 


2.34 


2.48 


Inadequate student-faculty contact ^ 


2.37 


1.60 


3.01 


2.06 


2:33 


InsufTicieht intellectual challenge 


2.35 


2.06 


2.42 


2.27 


. 2.31 


Lack of faculty care and concern 


2.30 


L58 


2.86 


2.01 


2.26 


Inadequate part-time employment 


2.37 


2.08 . 


2.49 


2.11 


2.26 


Unsatisfactory iiving accommodations 


2.04 


2.28 


2.24 


2.40 * 


2.25 / 


— ~ — Lowjquality of ^caching, * 


2.21 


2.00 


2.45 


2.10 


2.21 ' 


Lack of stafrcare^and concern_._\^ 


^2.i24 


" 1.69 


2.50 


2.07 


2.20 ^ 


Restrictive ruleis and regulations 


-lv38. 


f(53 


1.58 . 


2.08 


; 1:79 



Note: Figures are average ratings given by respondents on a scale of one (loSv) to five (High).- 

Source: Philip E. Beal and Lee Noel, What Works in Student Ret^tion: A Preliminary Summary of a National 
Survey {Iowa City, Iowa: American College Testing Program [ACT] and National Center for Higher Education 
Management Systems [NCHEAJS], 1979), p. 11, 10. • : 
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/interrelationship. Secdndly, these.are national trends distilled from a wide variety of 
; individual studies. It would'jje the heig^^ td apply.in every 

. institutional setting. Once again, they are supplied as context— to help those under- 
taking simple attrition stiadies to deternjine' in what ways they ^re similar to or 
different from other institutions. - 

A third and final question relates to the reasons why students drop out. Table 3 
summarizes responses to the NCHEMS/ACT survey on the campus factors 
positively and negatively related to student retention. Once again, caution should 
' be observed in generalizing'from these results. Nevertheless, important themes are 
-present and should be further illuminated through individual Campus-level attri- 
tion studies. 

Conclusions 

It IS not the intent of this chapter to provide a comprehensive and up-to-date review, 
of attrition and retention literature. The bibliography in this manual contains a. 
' number of review volumes and articles that effectively summarize the results of 
many years of retention research. Rather, the objective of this chapter is to put 
individual institutional efforts to collect attrition data into a proper context for. 
action. Smdent attrition is a complex phenomenon— perhaps the 'most complex 
those responsible for student success on campus inust face..Before embarking upon 
detailed study of a given situation, timeis well s^erit deciding exa^ly what is to be 
counted as attrition, and in planning how the results of any proposed resfearch effort 
are going to.be applied. . " 



Designing a 
Student-Tracking System ^ 



Many recent studies of 'attrition and retention have stressed the importance of 
" modeling college and university enrollmen ts as a continuous "flow" or * 'pipeline'' 
extending from admission to graduation (Runipf 1978). Students enter the pipeline 
^through^various=processes=such asnnitial^admissionr^ 

leave it thrbugh graduation, dismissal/transfer, and voluntary withdrawal. 

Figure 2 graphically illustrates the student pipeline of a typical undergraduate ^ 
^ institution. Inspection of this figure reveals.how complex the measurement of 
. student attrition can be. Because withdrawin'g students are not the only students , 
Jeaving the institution, they must be carefully distinguished froni those leaving 
after program completion and those leaving through academic dismissal or suspen- ^ 
sion. Furtherihorey the entire process is complicated by a continuous stream of new 
students entering the institutioathrough admission, transfer, or f eadmission. Each 
of these flows in and oij| of the institution is irylependent, and. changes ip each may 
or may not be detectable as shifts in total enrollment. ^ 

Because of the complexity of student flow, retention researchers have found , 
that estimating actual student attrition can be a considerable challenge. The 
accepted^-way to meet this challenge is to develop a studeht-trackirig system 
designed to directly monitor the enrollment histories of selected groups of students 
as they progress.through the institution. Such a stud'ent-tracking group is generally 
termed*^ ''cohort,'' and the most basic techniqv^e of retention research isjhus the 
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FIGURE 2 

Graphic Represhntation of Student Flow Model—The Pipeltne Analogy 
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"cohort study/' Designing a simple sequence of cohort studies using available 
enrollment data and responses to questionnaires such as those provided by SOIS 
constitutes the firsf^ and most basic task in any institutional retention-research 
effort: 

• <• . • ' . 

Some Elements of a Simple Cohort Study 

The basic ingredients for a simple cohort study are available to the majority of 
higher-education institutions in the form of a computerized student-record oystem. 
For institutions without such a system, manually maintained enroUriient records 
contain the needed data but they may be somewhat harder to locate and manipulate. 
However, most student-record systems, computerized or manUal, maintain distinct 
files that. contain each term's registration and enrollment information. The enroll- 
ment refcord of a particular s,tudent, over time, may be unusually difficuh to extract 
from such a database. 

In ojrder to overcome th'is situation, cohort-tracking<studies generally utilize a 
small and carefully selected set of data elements extracted from dislinct term- 
enrollment files, and assembled in a separate file tor analysis. For example, the total 
number of credit hours attempted by a given student in each term is identified and . 
' extracted from each of the term-data files;in which the student appears. This infor- 
mation is then, assembled in a single tracking file that contains that student's 
complete history of hours attempted by-term. 

A typical selection of data elements and the format for the resulting cohort- 
tracking file is presented in table 4. The array of actual data elenifents in such a file, 
as well as the structure of the file itself,'may differ from institution to institution. 
The essential logic of assembling cohort data should, however, be plairi: complete 
enrollment histories must be assembled for. each student in the identified cohort, 
■ an.d they must be organized in such a way that comjjarisons among the enrollment 
histories of difTereht kinds of students can be easily made and reported. 

Again, it is important to emphasize that a computerized student-record system 
is not . strictly necessary to accomplisfi this procedure. Many institutions have 
designed and implemented efFecfive manual studentrtracking systems by directly 
transcribing the, relevant information from student transcripts and tabulating the 
results. While this procedure is tmie-consuming, particularly when large numbers 
of students are involved, it can be quite effective in providing the needed informa- 
tion. Institutions facing this situation, however, would do well to consider sampling 
strategies in order to cut ■ down on the size of the task. For overall institutional 
purposes, for. example, it may be just as usefiil to track a 20 percent sample of a 
given entering class as to follow, the entire class. 

One of the most difficuh aspects of conducting cohort-tracking studies is ^ 
identifying all the members of the cohort to be tracked. In most studies, the cohort 
wilt be a complete entering class— all those who in a given term are attending the 
institution for the first time. WhilVconceptually a straightfom^ 
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assertion contains many ambiguities. Should special or nondegree students be 
included In the cohort? If not^ what should be done about those who will eventually 
change their status and enroll in degree programs? Shoufd transfers be included or 
only new entering freshmen? What about those readmitted to the institution after a 
long period of absence? There is no single set of right answers to these questions. 

Answers will depend upon the kinds of information needed, the particular, 
types of students about which information is needed, and the analytical resources 
available to. the institution to accomplish this study. For example, most cohort- 
tracking studies focus quite properly upon degree-seeking students, arid exclude 
from the^ analysis all not pursuing degree programs. Because most nondegree 
students are enrolled for only short-periods of time, and because in some types of 
institutions there are often a large number of them ienroUed, considerable labor can 
be saved by leaving them out of a tracking database. If a major question raised by 
administrators, however, is how and whether , current nondegree students can be 
eflfectively induced to enroll in degree programs, there is a strong case for tracking 
all students regardless of entry status. , ■ . 

.^Once_established,.^^o 
^ answers'to-m^ny-comnToni^uestion^.":^^ cohort stuciies are the^only 

reliable method of actually determining an institution's gross attrition rate. 
Term-to-term comparisons of total enrollnient by class or level are often termed 
^'attrition" studies. These comparisons, however, are based upon aggregate enroll- 
ment counts and are consequently subject to changes in all the gain and loss 
elements of-rhe total student pipeline. Only a miethod that tracks the , enrollment 
history of eacfriridividual student can produce a valid overall attrition statistic for a 
program or institution. 

^Furthermore, it is only through such a procedure that complex enrollment 
sequences can be discovered and assessed. As discussed in the previous chapter, 
stop-out patterns: in which students interrupt their enrollment for one or more 
terms are increasingly common. Such patterns, often compounded by shifts from 
part-time to fulF-time status, can completely invalidate aggr^egate methods for 
estimating attrition. - 

Once data from an identified cohort have been collected, the results, must be 
compiled in such a way that they are immediately useful to institutional 
policymakers. Most cohort-tracking efforts report the ''survival" of the cohort after 
a certain number of terms have elapsed. For exaniple, a community-college enter- 
ing cohort might be assessed after four terms— the minimum length of -time 
theoretically required to complete' the longest program— or after six or more terms. 
Other kinds of institutions would probably choose longer tracking periods .Again, 
there is no single right answer about how long to track a given cohort . A good rule of 
thumbj however, is to report results after a time period has elapsed such that no 
niore than one-quarter of the original entering group remains actively enrolled at 
the institution. : ^ . 



A second important point is that cohort-tracking results should be displayed in 
such a way that comparisons among different student sub populations are 
immediately apparent/ Most attrition research, has uncovered substantial 
differences in the enrollment patterns of different demographic groups, and oflen 
among different programs as well (Sheldon and Grafton 1982). Attrition is oflen 
viewed by administrators as a one-dimensional problem. Displaying the distinct 
enrollment patterns typical of different kinds of students may, in contrast^ enable 
targeted retention programs to be developed around the known differences in 
behavior of particular student subpopulationsrAs chapter 5 will emphasize, such 
targeted programs have proveja to be far more effective than more general institu- 
tion wide programs. 

Table 5 provides an example of a typical report from a cohort-tracking system. 
The breakdowns by student subpopulation included in this table are what was 
deemed important for. this institution; many others might have been possible. 

Using SOIS Questionnaires in Student Tracks 

Simple cohort-tracking studies can provide administrators the most basic informa- 
'ion about student attrition^ at a particular institution. This information includes 
the overall attrition rate, the particular student subpopulations experiencing high 
or low rates of attrition, and. patterns of enrollment in particular , institutional 
.programs. While critical, such studies tell the administrator relatively little about 
why such patterns of attrition occur and what can be done about them. Questions 
: such as these can only be answered through surveys administered to students while 
currently enrolled, and if and when they withdraw. 

The six questionnaires that make up the SOIS system are explicitly designed to 
be administered in conjunction with an ongoing student-tracking effort. Figure 3 
illustrates the typical flow of students through colleges and universities and shows 
the six data-collection points covered by SOIS instruments: . - 

O . . . ' ' ' 

— As a student enters . - 
. — While a student is enrolled 

— After a student leaves without graduating or completing a formal 

program ' * / 

— As the student-completes a program or graduates 
—Three months to one year after completion or graduation 

— TJiree to five years after completion or graduation 

Timing the administration of ISOIS questionnaires so that the cohorts of 
students identified for tracking are administered questionnaires as they progress 
throiigh.the institution can considerably enhance the database upon which reten- 
tion research must rest. For example, if data on studept goals, aspirations, , and 
perceptions of the institution are collected on entry, they majr be correlated with 
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later enrollment patterns. Questionnaire responses on the entering- and continuing- 
student questionnaires of persisters and of withdrawing students can be compared 
tc determine if differences in initial attitudes and perceptions might have been 
responsible for withdrawal. Furthermore, responses on former-student or alumni 
questionnaires can help administrators determine, the degree to which students who 
left the institution think that they have met their educational goals. Such responses 
can help clarify the proportion of students who withdraw due to "institutional 
failure." 

In fact, several institutions are using responses to the Entering-Student Ques- 
tionnaire to help predict sttdent attrition (Bishop 1984). Based upon past student- 
tracking studies where both questionnaire and enrollment data were collected, 
researchers at these institutions have identified* the patterns of response that 
identify **high-risk" students. The results have then been. passed on to counselors 
and. advisors to aid them in targeting individual students for special attention: , 

When using SOIS questionnaires in conjunction with cohort-tracking studies, 
questionnaire administration cycles and sampling procedures should be designed 
to correspond with the entrance of particular cohorts and with the tracking period 
established for reporting statistics on cohort survival. Ideally;, Entering-Student 
Questionnaires should be administered at time of matriculation to every student in 
an identified cohort. This would imply, for example, that if every other fall 
entering class was identified for tracking, all members of these classes would also 
complete the Entering-Student Questionnaire. Similarly, the " sUryivors of each 
cohort would be identified a year after entry and. administered the Continuing- 
Student Questionnaire. * 

If the number -of students in a given entering cohort is extremely large, a 
sampling procedure may provide an. efficient alternative to surveying every 
student. Care must be taken, however, to ensjure that a representative. sample is 
obtained and. that the students originally -identified as members of the sample are 
recontacted to obtain their responses to later questionnaires. Sampling procedures 
also have the diisadvantage that they will not ordinarily allow meaningful com- 
parisons between students in different programs unless the programs. compared 
have parlticuiarly large enrollments. In fact, it is probably better to administer 
questionnaires to selected complete entering cohorts (pejrhaps every other or every 
third year, for example) than to a small sample of every cohort to be tracked. For a 
more complete discussion of sampling and administration cycles assbeiated with 
SOIS, see chapter 2 of Student-Outcomes Questionnaires: An Implementation 
i/awc/6a&^. Second Edition (Ewell 1983b). • 
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Conducting 
Former-Student Surveys 



This chapter provides guideline's for administering a mailed survey using the SOI^ 
Former-iStudent Questionnaire to students who have dropped out, stopped out, or' 
transferred. These guidelines are based on recommended survey-administration 
practices as well as the experieince gained from conducting pilot-test attrition 
studies at a number of institutions. The chapter's purpose is not to prescribe rules 
for conducting attrition surveys but rather to suggest procedures and to identify 
potential problems and their possible solutions. Institutions differ from one 
another, aud variations in institutional needs and problems will almost certainly 
require deviation i7em the guidelines offered. * 

Most importantly, instxti!tibns should not see administration of a survey to 
students who have dropped out as>a Stand-^lone exercise. As stressed in the previous 
chapter, data gathered from former students by the methods described iiijhis 
chapter are at their most useful when viewed in the context of attrition statistics 
provided through a cohort-tracking study and when the resporiscc to the question- 
naire can be directly compared with similar responses obtained from gradu5ites or 
currently enrolled students. One of the. most common mistakes to be made in con- 
ducting student-attrition studies is to simply survey former students and toasisumie 
that their attitudes lare distinctive. Many misinformed institutional retention 
efforts have resulted from this miistake, and it is a critical one to avoid (Terenzini 
1982): " \ • 



the Questionnaires „ 

The two forms of the SOIS Former-Student Questionnaire (for community- 
college students and for four-year college and university students) are shown in 
appendix A! Although these questionnaires have essentially the same content, they 
have been tailored to the two-year or four-year student target group. Each SOIS 
questionnaire contains: 

• An optional personal identification section (name, address, telephone, 
and student identification number) 

Demographic background questions (sex, ethnic category, age, marital 
status, handicap status, and length of attendance at the college) 

• A set of questions about goals and achievements in attending college 

• A set of questions about attendance at the collq;ge ; 

• A set of questions about student reasons for leaving 

• Questions about degree of satisfaction with various college 3ervices, 

• A question on plans for additional education . . 

• Optibnal local items (up to 15 questions that the administering insti- . 
tution may add) - 

• A space for Written comments from students 

Users of ihz SOIS Former-Student Questionnaires have occasionally ques- 
tioned the necessity of items (such as sex, race/ethnic group, grade-point average) 
that request information already contained in most institutional master liles. 
Eliminating such items would shorten the questionnaires and perhaps improve 
response rates. Nevertheless, these items are included in the standard SOIS 
Former-Student Questionnaires because: 

• The iiistitutional master file may not include all such items for all 
students ' 

• The institutional master files may be outdated for some students 

• Even if the data are complete and up-to-date, it may be adminis- 
tratively impossible for the survey researcher to obtain access to the^ 
master file 

Some institutions may ^yish to administer the questionnaires 
anonymously and consequently cannot access the master file for 
match^g 

■ ' \ ■ ' • ■■■■ ■ 

Institutions mayswish to add local items to the standard SOIS Former-Student 
Questionnaires so thatahey can^coUe^ information relevant to their particular 
situations. In each questibnriaire,.spaces have been set aside that allow respondents 
to record their answers for ■lip.to 15 locally developed items. In general, the process 
for adding local items to the Former-Student Questionnaire involves three steps; 



1. Local items arc developed. (There can be no more than nine responses 
to any single item, if the institution plans to use the NCHEMS/CoUege 
Board Questionnaire-Analysis Service. Keypunchii^g and methods of 
analyzing responses make this requirement necessary.) 

2. Specific instructions are written that tell respondents how to record 
their answers to each local item in the appropriate space in the SOIS 
I^ormer-Stydent Questionnaire, 

3. The attachment that'includes the instruction and the local items is 
printed and attached to the SOIS Former-Student Questionnaire. 

Local items are often useful in identifying particular .areas of student 
dissatisfaction or to probe the needs of particular ^student populations that have 
experienced high attrition rates. A guide to developing local items" for SOIS 
questionnaires is provided as appendix C of Student-Outcoines Questionnaires: An 
Implementation Handbook, Second Edition (Ewell 1983b). 
(J The Former-Student Questionnaires themselves can be obtained by using the 
order form at the end of this book or by writing to NCHEMS Publiptions, P.O. 
Drawer Boulder, Colorado 80302, and requesting the type'ahd number of each 
questionnaire needed. NCHEMS and the College Board make the SOIS Former- 
Student Questionnaires and the other SOIS student questionnaires available in 
bulk at a price that covers the cost of printing and niailing, Questionnaires are 
shipped within five days of receipt of an order. (See the order form for specific cost 
information.) 

Identifying Questionnaire Recipients 

If an institution Has established a cohort-tracking system as described in chapter 3, 
identification of withdrawing students is a straightforward exercise. Student iden- 
tification numbers for students no longer enrolled and not graduated can be pulled 
ft-om the cohort-tracking files, and their last known addresses can be obtained from 
the student database. If an institution has not established such a tracking system, or 
if it wishes to survey a// dropouts— not ju6t those from the cohorts identified for 
tracking— more complex procedures must be used. These procedures will yary^ 
according to the method of institutional record keeping. What kinds of records are 
kept may depend on the: 

• Degree of automation ..r- 

• Withdrawal procedures for students; - - , 

• Length of time into the next term before dropouts from the previous * 
term can be identified ^ - " 

. • Accuracy and extent of records related to withdrawals and nonreturn- 
ing students . . ' 



, In most institutions, there will bd two kinds ofnonreturning students; Type 
A— those who register for a term and ^either fail to attend classes or attend classes 
only for a short period of time and then withdrawj-and Type B— those who finish 
one term and fail to register or return for the next term. Most institutions keep some 
type of records on Type A students because of tuition-refund requests and the 
standard withdrawal procedures that students are required to follow. Few institu- 
tions, however, keep records on students who do not reenroll between terms (Type 
B withdrawals). Figure 4 illustrates the cycle of nonreturning students over two 
.terms. 

Most institutions fall into one of thrde categories with respect to the degree of 
computerization of student records: 

1. All records are computerized. Including registration information for 
each term and withdrawal information (rebates sent, withdrawal ^ 
status, and so forth); that is. Type A and Type B withdrawals can be 
identified by computer. 

2. Uo records are computerized; that iS, all registration and withdrawal 
information is kept manually. 

3. Some records are computerized and^ome are kept manually. Usually 
registration information is computerized and within-term withdrawal 
and rebate information is notj that is. Type B withdrawals can be iden- • 
tified by coniputer but Type A cannot. 



FIGURE 4 
Cycle of Nonreturning Students 



-Term 1- 

I 



Type-A withdrawals 
Formal records 
(refund requests; 
withdrawal procedures) 



I 



Type-B withdrawals 
No formal records 



-Term 2- 



Type-A 
withdrawals 



. - Type-B 
withdrawals 



Source: Calhleen Patrick, Edward Myers, and William Van Dusen, A Manual fo} Conducting Student Attrition Studies, 
, Revised Edition (Boulder, Coio.:NCHEMS, 1979), p. 11. - 



Three dropout-identification strategies .can be developed that correspond 
these three ciltegories; 



1. All records computerized 

a. To identify within-term dropouts (Type A), print a list and create a 
new file of all students who have received a rebate after withdrawal, 
have a withdrawal-code indicator, or have any other institutional 
.code indicating that they 'have dropped out, 

b. To identify between-term dropouts (Type B), match the regis- • 
tration file from the previous term against the registration file for 
the current term. Print a list and create a new file of all students who. 
attended the previous term and who have not registered for the 
current term (excluding graduates). A new file, of nonrpturning 
students (excluding graduates) can be created by matching the new 
file of students who did not return beiween terms against the file • 
containing a list of graduates from the previous term. Note that this 
procedure will hot identify current term stop-outs. Institutions may 
wish to define dropouts as those not enrolled for two or more terms 
as an alternative to the "above. 

c. If both types of dropouts are to be surveyed, merge and sort (by 
student identification number) the two files produced in steps la . 
and . lb, after first eliminating any duplicate records for the same 
student. 

2. No records computerized , ^ 

a. To identify within-term dropouts (Type A), compile a list from all 
available sources of students who can be determined to have 
withdrawn after registration. These source might include deans' 
offices, where withdrawal forms are required for existing students; ' 
the accounting office, where students have requested refunds; and 
faculty members and student advisors, 

b. To identify between-term dropouts (Type B), obtain lists of - 
registered students for the current and previous term(s). (Both lists 
should be sequenced similarly, either alphabetically or by student 
identification number.) Visually compare the two lists name by i 
name, putting a mark by the names of students who enrolled for the 
previous but hot the current term. Obtain a list of students who 
graduated in the previous term(s). (This list should be in the same 
order as the others.) Visualjy compare the list of graduates with the 
list of students from the previous term(s) who have marks by their 
names and indicate with some other symbol those who have failed 
to reenrbll. Be sure to exclude those who graduated. AH students so 
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* Idcnilflcd should be listed in the same ordfcr as students Identified In 

step 2n. I " ■ 

c. Ifboth types of dropouts arc to be surveyed, any dupllcatp names 

should be eliminated and the two lists from steps- 2a and 2b shoulq^ 

be combined Into one list. 

3. Registration records computerized; withdrawal and rebate Informa- 
tion not computerized . 

a. To identify wlthln-term drppouts (Type A), follow procedure 2a. 

b. To Identify between-term dropouts (Type B), follow procedure lb. \ 

• If a file for graduates from the previous term is not available, obtain \ 
a list (In the same order as the' registration computer file) of those 

who graduated at the end of the previous term(8) and compare It 
vftually to the printed list of,between-term nonreturning students. 
Make a mark by the names of students who are. graduates. 

c. If a computer master file'exlsts contalhing student addresses, th 
•■ all noncomputerized lists should be computerized by entering the 

lif* of graduated students' Identification numbers and the list of 
' students identified In step ,3b. These files should then be matched • 
'* against the address master file In the same run that the new file 
created In step 3a is matched against the address file. Ifboth types of 
'dropouts are to be surveyed, a final file should be created of 
between-term dropouts' (w^® are not graduates) and merged with" , 
the file of students Identified from other sources (In step 3b) as 
wlthln-term dropouts. 

d. I£ a computer master file containing student addresses does not 
exist, all Information should te converted to lists. Ifboth types of 
'dropouts are to be^surveyed, the computer printout from step 3a 
should be merged with the Hat from step 3b, after first eliminating ^ 
any duplicate names. < , 

■jhe minimum Information needed from the master file about each "dropout, 
once Identified, consists of.name, the term and year of withdrawal,, and an off- 
campus address. This address may he the student's forwarding address or that of a 
'parent. Additional information from themaster fil'e may be useful in analyzing 
data. This Includes the student's sex,' ethnic category, grade-point, average, and 
majoj field. Information of this kind can be used ln: 

• Filling in missing questionnaire responses . • ' <• . , ' 

• Comparing characteristics of students who returned a guestlonnalre ' 
with characteristics of those who did not. In order to assess response 
bias (see chapter 5) 



• Checking the accuracy of master-file information by comparison with 
more up-to-date survey responses 
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AH information about dropouts (address^ background^formation, ^date of 
withdrawal, and so forth) should be kept together for each student, regardless of the 
degree of automation. 

Sampling Guidelines 

In every survey, staff must deterniine how many students to survey. There is unfor- 
tunately no definitive answer. In general, the survey administrator must strike a 
balance between cost considerations and statistical-analysis requirements. In attri- 
tion surveys^ moreover, an additional factor— the anticipated response rate- 
acquires considerable. imporiance. This is because response r ates are usually much 
lower in^ attrition surveys than in surveys of graduates„ or curreri%--^nr611ed 
students. 

, .. Many sophisticated statistical methods exist for estimating the size of the 
sample needed for good confidence in the reliability of results. These methods, 
require that the survey administrator estimate the, magnitude of response dif- 
ferences expected in the results. : Ho>yever, often il^ i impossible to : estiniate 
accurately these differences before administering the survey. As an alternative^ we 
recommend that the survey administrator aim for a sample of at least 1,000 
students. Small institutions ; may have to sample, dropouts from several years to 
obtain a total sample of 1,000. . If a sample that large cannot be'obtained, 750 will 
still produce credible results. ;4ny fewer may not yield enough returned usable 
questionnaires to sustain reliable conclusions. Large institutions, on the other 
hand, may easily attain a sample of 1,000 in a single term or year. Survey adminis- 
trators of. such institutions will have to decide whether to select a sample of 1,000 
randomly from the population of dropouts or to survey all identified dropouts 
within a particular interval. 

Two other factors are also important in determining sample size: statistical 
validity and response rate. If particular student subgroups such as ethnic groups, 
sex, and degree categories are to be analyzed separately, sufficient numbers of 
students within each group must be surveyed to provide statistically meaningfiil 
responses within each subgroup ■ What constitutes a sufficient size for a subgroup 
sample is difficult to determine. A minimum number of returned usable qutsiion-) 
naires would be about .30; a good number to aim at would be 50. : . 

A decision must also be made about the number of previous terms from which^ 
students will be sanipled. If a sufficient number of dropouts can.be identified from 
the records of the most recent year, there will be little reason for sample from ^ 
previous years. This is because response rates will probably be highest for the most 
recent dropouts.and because the institution will be most interested in them: Some 
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institutions may have ;;too a good sample, 

however. In this case, , the survey shouldlnclude dropouts from the last several years 
to obtain a 'Sufficiently large sample, given .the expeet^d-low-response rate. 

It is generally not a good idea to survey dropouts from only one term. Students 
who drop but in a particular term may differ in several ways from those who drop 
out in another term. For example, students who leave between spring and fall terms 
often transfer to other institutions, while midyear and midterm dropouts leave 
more often for personal, emotional, or financial reasons. Even if enough students 
drop out in one term tq constitute an adequate sample, the survey should include 
dropouts froni each term throughout the year. 

An additional problem is obtaining usable permanent-address records for 
former students. Usually from 10 to 20 percent of students either have foreign or in- 
valid permanent addresses. Students with no permanent address (or with obviously 
incorrect or inconiplete addresses) will, have to be eliminated from the survey. 
When planning for a specific samplef size, the surveys administrator should 
remernber that usually 10 to 20 percent of the sample may not receive a question- 
naire because of an incorrect or incomplete address. If random sampling is used to 
obtain a final sample; of 1,000 students, or if a school is combining dropouts from 
several years, the survey administrator should aim for an initial sample of 1,100 or 
1,200 to compensate for the 100 to 200 students who may be eliminated from the 
survey Jbecause of incorrect or incomplete address^^ 

■ fi ' . ■ ■ " ■ ' , . • . . 

CoverLetters 

■Appendix D contains examples of cover letters suggested for the initial mailing of 
the questionnaire and for subsequent follow-up mailings to those who did not 
respond to the first mailing. These letters should be printed on institutionarstatio- 
nery and, if possible, be signed .by the president: Both are suggested formats. If 
changes are made, however, several important points should be remembered. 

• The initial letter should convey the importance of receiving a response 
from the student ^ 

• It should state that responses will^^^ 

• It should reflect the awareness that students may h^ 
should assure the stiident tha^^^^^^^ 

- receipt of the questionnaire. 

• The initial and follow-up letters should both state whether the optional 
personal identification section is tb;be completed by the student . 

• If there are local items, the initial and follow-rup letters should indicate 
this fact and describe any special instruction pertaining to, these items 

• The follow-up letter should reiterate the confidentiality of responses 
arid the importance to the institution of receiving as many completed 
questionnaires as possible. 



Initial mailing of questionnaires can begin as soon as a list of each student's identifi- 
. cation number, name, and address is available. In assembling and preparing the 
materials for mailing, staff will: ' 

L Eliminate inyalid, missing, or foreign address -labels by marking an 
*'X" through them. (If envelopes are typed, this should be done at the 
time of^^ tag^ ) - - ■ - ~ 

2. Eliminate students with invalid, missing, or foreign addresses from the 

list of students. ' ^ a 

3. Number;in ink the self-addressed return envelopes, in the, lower left- 
hand corner of each envelope, beginning with 0001 and ending with 
thenumberofvalidstudentaddressesinthesample. Thenumbers will 

. ; be used to keep track of who has responded and who has not . " 

4'rNumber the list of each remaining student who has a valid address 
with the same consecutive numbers as in step 3. Steps 3 and 4 ensure : 
that returned questionnaires with incorrect or insufficie 
information can be niatched vvith the student's name and id 
number if desired. As an alternative to numbering from 0001 to the 
•number in the sample in^steps 3 and 4, one could eliminate step 3 and 
; simply write the student's identification number on ^:t return ^^. v vv 
envelope. The advantage of using the identification''nu is that no 
intermediaterStep^STrequired-to-match-th^^ wifBTthe . 

student if a/questionriaire is returned withouL identifying information. 
A disadva^iitage is that students niay be disturbed to see 
tion number written on the return envelope. (Use of the'identifi^^^^ 
^ number may also raise'fegal questions:) Thus we recommend that the 
, consecutive nunibering system be used. The purpose of this number 
can be stated in the cover letter. _ 

5. Put folded questionnaire, cover letter, and return envelope in each^ 
mailing envelope. Stamp mailing envelope PLEASE FORWARD. . . 

After the initial mailing, a set of tracking sheets should be prepared for record- • 
. ing^the status of returned questionnaires. Figure 5 s^ 
institutional records are computerized or if names and addresses of students were ' 
keypunched to produce labels, the tracking sheets can be produced by computer^ > 
.otherwise they must be typed. The tracking sheet should contain: 

1. Student's identification number ^ 
, : 2. Student's name # 
3. Student's address 
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,. , ■ FIGURES ' , V 

Tracking Sheet with Example of Institutional Entries 



RETURN- « 
ENVELOPE 

NUMBER ID NAME 




RRSTMAIUNG 


SECOND MAILING 


ADDRESS 


Undellvtrable Unusable Usable 


Date Sent Undellverable Unusable Uiablt 


0001' 0,122356 Mark Andrews 

■ , ' • ' 


314W.8tliAve. 
Jorfolk,VA 10823 


■ 2/9 : • 


' ' .'.'*.■»■..' 


0002 9262230 . Alice Byers 


AptJB' 

7013 MaryiaiiQ flvci ' 
,Los Angeles, CA98122 






0003 1135y7o KOperliJavis , 


'New York, NY 10220. 




2/29 • ■ ■ 3/i5>. 

, ■ , .■ ■ , ■ ' , ■ : ■'■ 
1 ■ ^ ■ ■ . -"i ■ '■ 


,0004 . 4399178 tan Ford : 


91BtandDrive:;X 
Rockaway,NY:11691 ■ 




. §'■■■,. ' - ■ ,■ .■■■■;.:.V'^, 


0005 ■ , 2123947 David Harris 


■123 "Table Mesa Drive' 
Boulder, Ga8P303;. ' 


' ■. 1 1 ■ 

1 . ■■1 . 


' ' * ' , ' ■ I ' . ' ■ . . ■ *"" '. . . . i' 


SOURCE: Oithlttn Pairick, Edward iiyers/and Willi^^ 


n(BouteColo;NCliEMS,^I97|p.22,;:";^^ 



} ... 




^ ,^ ^ v" \ . i ^ r 'a 

4. Blank columns for recording ;the date the following are-received: , 
. a. Materials returned by the postal service as undeliverable 

• b. Unusable questionnaire (student ineligible, unable.to.respond, im- 
properly identified-Tas dropout, and so forth) 
c. Usable questionnaire 

5. If other mailings are planned, blank columns for recording second and 
subsequent mailing information: ' 

a. iDate second set of materials sent 

b. Date returned by the postal service as undeliyerable 

c. Date unusable questionnaire or letter received (student ineligible or 
unable to respond) 

d. Date usable questionnaire returned ;. 

As questionnaires are returned, one person should be in charge of recording the 
information described above. An identifying mark should be.niade on each ques- 
tionnaire as the proper information is recorded on the tracking sheets. If possible, - 
the person who records th^ information should also open the ehy^ to ensure 
that questionnaires wjth insufficient identifying info^^ matched with 

the student*s correct name andidentification number. All returned ma^^^ : ; ^ 

; : undeliverable questionnaires) should be saved until the end of the survey. 

Proced^ures for^^^c^ a follbwr^^ for the ■'■■^vS' 

initial niailing. A second cqvef letter should^ howevei^ be prepared for the follow- i i 
up. A hew set of materials should be^enttb'eac^ 

mailing. and not identified as having a bad address. The date the second maiUng is 
; sent should berecorded for each student, and responses shoiild be recorded on the ^ 
■:■■■■>, >' .tracking sheet; -'v' ■ -^'-'i-r- : ■ Y'^' '' ' 

institutions with a pri^^ local clientele might also consider^ , a telephone 
follow-up: In a:telephbne follow-up, st^fFcalleach st^ in the sample about one ^ ^ 
> week after the initial mailing to ask (in a positivb manner) if he or she received the 
questionnaire and if he or she has any questions. 'The caller can also emphasize the 
importanc^of the survey and urge the student toW^ 

, Follow-up materials should be; sent w^ the frequency of responses frbnithe 
. • first mailing begins to drop. For exam^ 20!questionnaires are 

. ' returned;then 10, then 2, one can safo^^ 
, and the second mailing can begin. This, point wi^ 

four \yeeks after the initial mailing. If the survey adniinistrator wants to distinguish ' 
late:responses firpm the first mailing from responses to the second mailings the ques-^ 
: ■ " . tionhaire for the second maiUng can be printed on a diflerent color paper. T3iis may : 
, be usefol in determining if responses to the diflerent mailin]p we^^ 
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Costs, Materials, and Personnel for Administering Questionnaires 

Figure 6 shows a list of materials required for the initial contact ia mail surveys, 
along with their estimated costs. Costs are based on an initial contact of 1,000 
students; surveys of larger or smaller numbers of students should involve costs that 
are approximately proportional to those shown. Most costs in figure 6:.are self- 
explanatory, except perhaps the first-class mailihg expense. Research indicates that 
personalising the survey materials generally increases the response rate. In 
particular, studies show that using first-class postage, particularly commemorative 
ijtamps, can be especially effective in increasing response rates (Hensley 1974; 
Champion §nd Sear 1969). Because a good response rate is important, the added 
expense of first-class postage on the outside mailing envelopes over bulk rate is 
often justifiable. First-class mail has the added advantage of being forwarded by the 
post office. 

One study (Rossman and Astin 1974) indicates that use of nonprofit permits on 
the outer envelope combined with a foUow-up mailing using first-class postage 
yields response rates only 2 to 3 percent less than using first-class postage on the 
initial mailing. Thus, an institution should consider using nonprofit-permit 

'postage on the outer envelope and first-class postage on a second mailing only for 
those questionnaires returned undeliverable by the post office. There will probably 
be increased personnel time (and a slower overall . response time) required to 
monitor the returned envelopes and addresses and to send out new questionnaires, 
but for many , colleges, extra staff time is more readily ayailable than extra funds. 
Other mailing costs hot shown in figure 6 are those required for either typing 
names and addresses of students on the envelopes or for generating and affixing 

. computer-printed names and address labels. These costs vary depending on the 
institution but should certainly be included in cost estimates for the survey. At least 
one study (Carpenter 1974-75) showed that personalizing the cover letter by 
manually typing names and addresses increased the response rate over computer- or 
machine-produced names and addresses. Thus, if all other factors are equal, typing 
students' names and addresses is preferred. But if'the institution can produce the 
, cpmputer-generated labels at a substantial savings and is looking f^ 
cost of the survey, computer-produced labels are a reasonable alternative. ■ 
" Much Experience shows that a single follow-up mailing can substantially 

• increase the number of returned questionnaires (by 50 to 70 percent) but that 
returns from additional follow-up mailings diminish significantly (Dillman 1982). 

• Nevertheless, some institutions may decide not to send any follow-up materials, 
primarily for budgetary .reasons. Materials and 'costs for a follow-up mailing of 
questionnaires are proportional to those for an initial mailing. Thus the cost of a 
second mailing to 800 students will be about 80 percent of the initial mailing to 
vljOOO. These calculations are based on the assumption that subsequent mailings 
include a complete set of materials. This procedure generally produces a higher rate 
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. Estimated Costs b? Materials for Initial Mail Contact of 1,000 Students. 









estimated COSTS* 


,7, . . ■ , 

MATERIALS 

> • 


NUMBER** 


explanation 

II 


First' < 

Class 

Mail 


NonproHt 
Permit 
Mail 


Questionnaires 


1,000, 


Estimated at $.15 


$150.00 


" $150.00 


Cover Letters 


1,000 


s 

Printed on official stationery (.06/sheet) . 


60.00 


e'o.oo 


Return Envelohes 
(Size No. 9) .. • " 


1 000 ■ 


RiKinp^Q-rpnlv return pnvplnnpQ * * 

(a) Printing Vosts (.065 each) 

Ih) Po^fapp rosK flt $ 2S parh X "^Ofl retnrnpH 


65.00 


65.00 


■Mailing Envelopes 
(Size No. 10)- V 


1,000 

i 


Standard business size (.065 each) 


65.00, 


65.00 


i:First-Clas& Postage ^ 


1,000 


First-class commemorative stamps at $.20 each 


200.00 




^Nonprofit Permits 

rrUoi'vidoa i UbldgC lUr 

^Undeliverables . ^ 

'■' ^ ■ ' " ■ " ■ 


: 1,000 


(a) Nonprofit permits at $.059 each , , " 

ESllUlaieu iU pciLcni UnQCllVCraDlCS 

\:,,:;at:$.25;eachv,''''^:: 




•59,00 
• 25.00 


.^TOTAL -^V^ 




■ ■ , ' '.■"[■ ■ ' ' 


$615.00: 


$499!005 


Per-Student Contact Costs 






$ .62 


.$:'''.5q--i: 


Per-Student .Resi3onse Costs (estimating 30(j responses) 


,$:■ 2.05:; 


^$":).66::: 



■l1 



1'' /*Estimatcd costs for more or fewer than 1,000 / • ■* . V. 

Source: Peter T. 'Ewlly Student^Omom^ Second Edition (Boulder, Colo.: NCHEMS, 1983), p. 36; 



of response than a ppstcard reminder. Second and subsequent mailings will also 
require. preparation of a new cover lett 

.Costs involved ill undertaking follow-up activities for rionresppndents will vary 
with the type of activity chosen. Figure 7 presents approximate follow-up tosts for 
the three follow-up strategies discussed above, based upon a 35 percent return to 
the initial mailing. These costs should be added to those in figure 6 to obtain an 
approximate cost for total administration; 

The other costs incurred in. conducting a survey are primarily personnel Cj&sts. 
It is difficult to put dollar amounts on these costs becdfuse they will vary from 
institution to institution depending on salaries and time invested. The following 
potential personnel requirements, given without estimated costs, should be 
considered: > ^ 

• Survey administrator 

• Secretarial time for typing local items and cover letters 

• Computer personnel time for creating survey sample lists and address 
labels (or clerical time if lists are created by hand, plus typist time for 
typing envelope names and addresses) 

• Approximately 20 hours of clerical time for stuffing and mailing 1,000 

questionnaires 

• Clerical time fop recordings tracking, and editing returned ques- 
tionnaires . • 

• Report-writer's time 

• Secretarial time for typing reports 

In many ways, survey administration is more an art than a science. Each institu- 
tion should not be afraid to experiment with new techniques devised within the 
guidelines above that are appropriate to its data-collection plan. At the same time, it 
is important that all of the issues treated in the previous two chapters be covered in 
some way and that alternatives tp the above procedures be examined carefully 
before they are implemented. (Appendix B contains a summary survey-adminis- 
tration planning chart of all activities: an institution must accomplish to effectively 
administer an SOIS survey^) 
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, Estimated Costs of Materials for Two Types of Follow-Up Mailings to 70^udents ' 







* • , ■ 


ESTIMATED costs* 


I'v", 

I'materials 


NUMBER** 


explanation 


First-ClasV 
Mall ^ 


Nonprofit 
Permit Mail 


ll^uestionnaircs 


700 


Estimated at $.15' 


$105.00' 


\$105.00 ' 


Itover Letters 


700 ■ 


Printed on official stationery (.06/sheet) 


42.00 


Voo 


iReturnrEnvelopes . 
Willi m. v) 


1,000 

• 


'Business-reply return envelopes 

(a) Printing costs (.065 each) 

(b) Postage costs at $.25 each x 200 returned » 


45.50 
. ■ 50!00 


45.5V 
' ' 50.00 


IMairmg Envelopes 
|(iiize No. 10) 


700 


Standard business size (.065 each) ' 


45.50 


45.50 


IFirst-Class Postage 


,700 


First-class commemorative stamps at $.20 each , 


140.00 

0 




nonprofit Permit 


'700 : 


At $.059 each 




4l'.30 








, $428.00 


$329.30 


|Per-Student Contact Costs ' 




■ "1 ■ ' ■ i 


% ■ .61 , . 


$'. .4,7. ■ 


^e^Stiidetit Response Costs (es'timaii^^^ - ■ 


$ 2'14 


$ 1.65 ' , 



JAs'6fl983 ' .-^ . • ' 

J,Gost$ jn.this figure based on an initial return of 300 questionnaires, leaving 700 for ilie second mailing. 



toVRCE: Peter T. E^iW, Student-Outmes Quesmmm: An Implmemtion Handbook, Second Edition (Boulder, Colo.: NCHEMS, 1983), p. 38. 



Applying the Results of 
Attrition Studies 



Attrition studies are of little value if the institution does not take action on thebasis 
of the results. UnfbrtunatBy, it is coinnion for institutions to 
student attrition but never to effectively utilize the informiation gathered. Often thfe^^^ 
is a product of the way data aire report^d^^sw be emphasized, in order to be effec- j 
tively^used by administratorss data reports should be shortvsuccinct, and problem 
directed.\)ftehv howeveiv data are u^ 

steps requires ca//^cfzz;eattibn on the part of the institution. EfTective utilization of 
the results of retention research may thusjinvolve creating a cam pus\videcom^ 
to consider the implications of such research. The purposes of this final chapter are 
to allow those conducting attrition studies using SOIS to assess the quality of the 
djjta obtained, to suggest appropriate ways these data ban be put into a form suited 
to the needs of administrators, and to give examples of th^ kinds of institutional 
retention programs that can be developed as a result. / ^ 

Assessing the Quality of Survey Data 

inerallyspeakingy the quality of survey data is based upon two factors: the quality 
of^the survey instruments used and the absence of response bias among those 
actually completing the questionnaires. The SOIS Former-Student Question- , 
naires, like all the instruments in the SOIS system; have been carefully constmcted : 
and extensively field tested to minimize inaccuracies and biases due to a respondent 



; misreadi^^ misunderstanding questions or instnictions. Nevertheless, question- ; 
haires should be carefully edited as they are received in order to assess the degree to ; 
which students have responded appropriately. 

A far more inipo^rant potential problem for those using surveys is res^ 
bias. Response bias exists when those who choose to respond to a questionnaire 
survey differ systematically froni the total sample to whom questionnairesowere 

' sent. Generally, response bias operates so that actual respondents tend to be'^more 
concerned, more interested, or more enthusiastic than those who choose not to 
respond to a survey. Respondents also may have stronger views and may have more 
positive feelings in general than those who do not respond. 

There are two general approaches in* survey research to the problem of assess- ^ 
ing response bias. One is to isolate a small . random sample of those who do not 
respond to the survey and to try to get valid responses from them through personal 
contact or interview. These can then be compared with the responses of those who 
originally returned questionnaires. Primarily for cost reasons^ this approach , 
usually is not feasible in any but the largest surveys. Another approach, which can 
easily be done in a small surveys is to examine the characteristics of respondents and 
nonrespondents using demographic/background data available in the institutional 
master-file records. Though, this approach is technically less valid, it can produce . 
useful insights into the response-bias question. Typically, institutions have in their i / 
records much information in terms of which respondents and nonrespondentsxan 
be compared. This information includes: 

. • Age *; • ' 

• Decree originally sought 

• Major field - . 

• Grade-point average _ 

' • Number of terms enrolled • 

• Date of withdrawal (if appropriate) 

Assessing differences between respondents and nonrespondents for these types 
of characteristics can be made by comparitig;£ercentages and means for the two 
groups. Comparison might reveal, for example, that 56 percent of the respondents ' 
are women, 49 percent of the nonrespondents are women, and the average age is 19 
for respondents and 22 for nonrespondents. In many cases, the differences may be 
negligible bet ween the two groups, incUcating U^^ 
the cAaracf^rmi^5 on which^^ 

moderate to subkantidl differences be^^ nonrespbndients. The 

important point in 'investigating the response-bi^^ is to document any . 

difftrences between the two groups and ^^^^ cautiously interpret questionnaire 
results to the extent that it is believed respondents; may represent a biased group. 

Among those doing Purvey analysis, the question is often asked. What con^ ; 
stitutes a 'good percentage of response to a questionnaire "survey? As the above ^\ 

o 
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discussion should indicate, there is no simple answer to this quiestion. A 50 percent 
response to a given questionnaire may be less representative tha^^ • 
response, depencling upon the diaracteristics qf those responding and those 
choosing not to respond; Generally speaking, a high response rate is bptter than, a 
low one in minimizing the problems associated with response Jpias, anj^ response ■ 
rates of less>;han 25 percent should be treated with extrieme caution. At the same 
time, whatever the response rate obtained, there is'no substitute for a earful assess- 
^inent^fresponse bias. , ' ^ — ^-.-.. -. .---■. ■^^ - ^ ^ — - 

* * " 

Reporting the Results of Attrition Studies 

Even, when different kinds of data on student attrition are properly collected, they 
are frequently not in the proper format to be of immediate use to decisionmakers.' 
The primary method used to' disseminate such data is in terms of a repofT>Qh the 
results ofra particular data-gathering effort. Each time a body of students is 
surveyed, the results are? presented as a distinct report to administrators— often 
paying little or no attention to the important relationships among studies. Such 
reports can be said to be methodology driven rather than'proUlem'driven. One of 
the first tasks in effectively utilizing attrition data is thus to integrate the findings of 
numerous individual studies to create an overall portrait of the retention problem at 
ia given institution. ° 

Subtle anH sensitive interpretation is sometimes required to effectively 
integrate fragments-of .irifdrmation--often by themselves of little significance— intoy 
a single coherent picture of a phenonienon. One such exercise, assembling the 
results of numerous attiuidijaal studies of currently enrolled students and 
integrating them with traclufig-study results on the attrition patterns of different 
kinds of students, has already been mentione can be-particularly eflrecLiver" 

However, much of the process of reorganizing existing material merely involves 
simplifying data presentations to highlight major trends, to eniphasize com- 
parisons, and to eliminate- extranet)us maferial. 

^ Figure 8, for example, graphically indicates the results of a student-flow study 
to highlight the issue of niinority^student retention. Table 6 presents results of ah 
attitudinal study within a particular department; this format is designed to 
highlight' the. ways in which key survey responses were similar'to op different from 
obtalllfed iqstitutionai averages. 

y A second useful approach to. presem^ the results of retention studies is to 
wganize data-presentation formats around identified issues and target populations. 
A common misperception in designing retention programs is that all istudents . 
experieiiice the sameJ^ kinds of problems. On the 'contrary, most research has shown 
that the reasons for withdrawal m^ depending upon which sub- ; 

population ofstuderits one is talking ab 

at the particular needs of identified student subpopulations, is ofleff3:onsiderabiy v 
more effective thain a single general program directed at all students. Appendix E 



TABLE 6 

Summary of Survey oeNonretvrning Students 





College/School: Sociai Welfarj^x 



Reasons for Not Continuing EnroUtneut 



Unit. Compared to Campus* 



Below 
Average 



Average 



Above 
Average 



Campus 
Average 



Academic Reasons: 



Achieved my academic goals 

• Transferred to another^coUege 
Needed a break from co^llege 
Courses/programs I wanted not available 
Dissatisfied with my academic performance 
Dissatisfied with quality of teaching 

. Dissatisfied with the- learning environment 
Unsure of my academic goals " 



47% 
41%. 



.9% 



4% 



.22% 



26% 

17%-' 
13% 



•36%; 

24% 

11% 

14% ' 
12%, 
31% 



Personal/Financial Reasons: ' \ 
Achieved my personal goals - 
'^cepte4. a job or entered the niilitary 

* Di3- not have nioney to continue ^ 

■ Collfegc-experience not what I expected 

* , Few people I could identify with * 

* Moved out of the area . " 

■ * ■• ■ * 
, Cou'ftkiaot work arid go to school at the same time 
V. • P V 

* Other responsibilities too great- , 



11% 
3% 



43% 
34% 
'22% 

15% 
28% 

42% 



39% 



46% 

^1%' 
27% 
22%' 
19% ' 
26% 
31% 
43% 



Enrolled or plans to enroll at another coUeg^ 



41% 



Numoer of re'sporidents: 87. r - 

Number of potential respondents: 123 , . . 

/ ■ ■ • ' - ■ - ■ ' ' ' 

^Assignment to '^berdj^: average," ^'average/* or "above average" category based on test of siRnificance (p<.10)of diflcr- 

ence between unit perceniage and that of all other respondents combined. W:\tn difference is nonsignificant, percentag? 

is given in "Average" (folurnn. ^ 



Source: Developed iii thevNCHEMS/Kellgg^ Student Outcomes Project. 



provides an example of a retention research report focused on the needs of 
particular idCiitified studerit subpopulations. 

Preliminary discussion and review of retention research findings by a campus- 
wide committee can also be greatly valuable. Indeed, much of the literature on 
developing effective retention programs stresses the. importance of the increased 
campus involvement provided by groups of this V'md (Noel 1982). There are a 
number of reasons why retention bonimittees ate of value. Most important, 
probably, is the fact that a single forum for discussing issues of student success and 
failure is almost never present in higher-education institutions. Moreover, the very 
structure of most institutions tends to preclude such discussion on a regular basis. 
Administrators thus seldom have the opportunity to view the institution as the 
student sees it— as a total envirpnment composed of many interlocking parts. 
Putting available data on retention and°attrition in front of a committee whose 
members are drawn from throughout the institution is probably the best way to 
make sure that all sides of the student experience are covered and taken into account 
when analyzing the data(Astin 1976). Such comniittees are often composed of deci- 
sionmakers in their own righi— individuals able to make immediate changes in their 
own units if the data seem to imply that chant;e&are warranted. Such changes can 
take place regardless of the content or outcome of cor?;imittee discussion. Finally, of 
course, committee structures are part of the conimpn flora and fauna of university 
life. In spite of the standard reaction **Not another committee," such bodies do - 
symbolize administrative concern and institutionalize efforts that btherwise would 
be extremely difficult to focus in a. complex, decentralized environment. 

Providing usefulreports of the results of retention studies takes^ime and ex- 
perience, The time spent and experience acquired, hbwever, will pay considerable 
dividends if ithe result is more effective student-retention programs. 

Using Data in Developing Student-Retention Programs 

Student-tracking studies and the results of current and former-student surveys— if 
reported effectively— can have a direct impact on programming and decisionmaking. 

Comparisons of the responses, of graduates; and former students may, for ' 
example, reveal considerable differences in academic and personal goals, as well as 
different perceptions of and satisfaction with the institution. Both kinds of informa- 
tion are highly useful in planning '^and implementing institutional retention 
strategies. A number'pf institutions are using results of student-tracking studies and 
former-student surveys to try to isolate a set of early warning signals of a student's 
impending decision to leave the institution (Siryk I98I). High-risk students can 
thus be identified at an early stage and be given special attention by counselors and 
advisors. Similarly, many institutions, are using' current- and former-student 
surveys to determine the levels of use of particular student services by dropouts and 
by persisters. If dropouts are not aware of, and not uising, or are not satisfied with a 



TABLE? 

Action Program? by Retention Impact and General Impact 



RETENTION INDEX GENERAL INDEX 



N N 



New policies, structures 


1 1 


J. 04 




*X 00 


Learning, academic support 


1 1 J 




1 00 




* Orientation 


Oo 


1 AA 


1 ID 


*X 01 


Early-warning systems 


45 


3.38 


97 


3,56 


Curricular developments 


'6 


'3.33 


13 


3,92 


Multiple-action programs 


14 


.3.29 


25 


4,04 


Advising 


61 


3.26 


115 


3.78 


Career assistance 


23 


3.26 


49 


4,00 


Counseling 


18 


3.22 


. 30 


3,80 


Peer programs • « 


9 


3.22 


. 31 


4,13 


Dropout studies 


9 


.3.22 


12 


3,33 


• Faculty/staff development 


10 • 


3,20 


25 


4,00 


Other 


12 


3,00 


32 


3,88 


Cocurricular activities 


4 


2,75 


20 


3,70 


Exit interviews 


15 


.2.67 


22 


3,23 


All ^ 


420 . 


3.33 


811 


3,81 



Note: Range of index is 2-5. 

Source: Philip E. Beal and Lee Noel, What Works in Student Retention (Iowa City, Iowa, and Boulder, Colo.: American 
•College Testing Program [ACT] and National Center for. Higher Education Management Systems (NCHEMS], 1980), 
p. 55. 

particular service^ efforts are made to improve its visibility arid the dimensions of 
service provided, ; 

Using attrition data to develop student-retention programs should be an insti-; 
tutionwide activity. Frequently the feeling is present on campus that retention is a, 
student-services problem. In fact, most student-outcomes research has shown 
program quality and faculty contact to be among, the major factors involved in 
retention (see Terenzirii 1979). Research also has shown that the most effective 
retention strategies are. institutionwide and have been developed with the full 
participation ^of all institutional constituencies— faculty, staffy students, and 
administration (Beal and Noel 1980), Once more, the importance of a committee 
_^ith broad representation from all constituencies to review the retention implica- 
tions of student-outcomes information cannot be overstressed, Gne public regional 
university has formally established such a committee in its governance structure, 
• with the responsibility to make retention recbnimendatioris to the president gri a 
regular basis. Reviewing andVdiscussing^ the implications of a. wide variety of 
student-outconies information is one of the committee!s primary tasks^^^^^ ; 

Although each institution will quite rightly develop its own retem 
based upon the characteristics of its students and the data available, it is useful to ; 
know the kinds of programs developed and termed effective by others. Table 7 
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presents results of the NCHEMS/ACT survey on What Works in Student Retention 
(Beal and Noel 1980). Results are reported in terms of the impact campus 
respondents felt each program had on the retention rate of the target group toward 
which the program was directed, and in terms of the program's general impact on 
campus. Interested readers are referred to the bibliography for numerous examples 
of effective campus retention programs . 

The Need for Communication: A Concluding Remark 

A significant obstacle to the development of effective, informed student-success 
programs is the structure of colleges and universities themselves. Student per- 
sistence and achievement are not generally attributable to any one feature or 
program of the institution. Instead, they are the product of a complex set of factors, 
. • working together and cutting across all aspects of college and university life. 
Individual faculty members and administrators, however, do not usually deal with 
more than a single aspect of a given student's involvement in the institution— as a 
student in a particu^ class, as a candidate for financial aid, as an admissions excep- 
tion seeking additiinal help in developing study skills, and so on, Furtho.rniore, 
precisely because student persistence and success are rarely attributable to a single 
office or function, assessments of individual unit or program success are most easily 
(and probably appropriately) directed at the contents of the services delivered 
rather than at the effects these services produce. Because of its holistic nature, 
student success is everybody's business but n specific responsibility. 

Dealing with this situation at. any institution requires at least two kinds of 
initiatives— neither directly related to the amount and quality of information on 
student attrition and retention available. First, it requires a plain and visible 
commitment by top administration that the issue of improving student retention 
and success is a priority and that unit initiatives consistent with this pr iority will be 
• rewarded. So long as the standard of managerial accountability remains efficiency 
rather than effectiveness, the likelihood of information about retention being 
utilized, regardless of its quality, remains low. 

The second requirement is coordination and communication aniong the 
, various efforts undertaken as a result of such a commitment . This requirement is, 
perhaps most significant when niobilizing daJ;a resources: Each unit head must not 
only understand !the\§^oa/5 of contemplated student-success programs but should 
also understand the potentially reinforcing or conflicting ihterrelations among the 
hew policies affecting different units. Finally, the different units involved in 
achieving the goals of such programs must frequently share irifpr mation— not only 
on what they are doing and plan to do but also on what they have learned indivi- 
dually about the factors idetermining successful outcornes for different kinds of 
students. 

Only in the context of these two initiatives can student-retention programs at 
. colleges and universities be expected to be truly successful. 

■ ■ ' : ' 50, ■ ; . ■ 
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Fornier-Stu 
Que$tloniriaire 

(Two-Year Institutions) 



PERSONAL rOENTIFICATION SECirON 

Do not complete this section unless you are asked to do so. Please print 



LAST 
NAME 



























FIRST 
NAME 



















■13'2Q ■ 



MIDDLE 
INITIAL 



□ 



ANY OTHtR NAME WHICH MAY APPEAR ON YOUR 3CHOOL OR COLLEGE RECORDS 



: STUDENT IDENTIFICATION NUMBER 



TELEPHONE NUMBER . 



. PERMANENT MAI LING ADDRESS 
STREET AND NUMBER- 



























1 1 1 -1 










1 







QTY 



STATE 



71-72 



ZIP CODE 



Lll 



National Center for Higher Education Management Systems 
! . y ; , V ! Tlie College Board 



student-Outcomes Information Services 
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STANDARD QUESTIONS SECTION 



INSTRUCTIONS: 

Specific directions *are given forcompleting manV of 
the questions in this questionnaire. Where no directions 
are given, please circle the number or letter of the 
mo^t appropriate response, such as in the . sample 
question below., • . 

Sample: . 

4. Are yoLi curreritly married? 
0 Yes 
©No^ 

If you are npt currently married, you ^vould circle the 
number 1. ^ 



-.1. What is yoLirsex? 

CO Female. 
1 Male 



.2. Hovv doyou describeyoursel 
rO American Indian qrAla: 

1 Asian. Pacific.ls/ander, 

2 Black or Afro-American 
jTHispanic, Chicano. orSp, 
4 White or Caucasian 

i-5 Other _ ' 



3. . How old are yoi 
r-0 Under 18 



18 to 22 ye'ars 
23 to 25 ydars 
26to30yoars 
31 to 40 yia 
41 to 50 yba 
51 to 60 y 



4. Are you currently 



6. ^How long did you att^end our college? 
V-0 One term 

1 One year 

2 Two years 

3 Three years j 
A Four years , 

—5 More thaniour years 



The follovvin^^^ 
>students. 

of (hose Jipa®l 
attended 6^^(qoU' 
letters of /those go 
. achieved as a result c 




l^reflect the-goals of many colk.'go 
^"^%hrv^^ie. circle the letters^ 
^im^^^^to YOU when yoO 
^^Mj Co/t/ma circle the 
{rare a'chievirtf; or have 
fences at our co//ege.. 

^me 



g ^oals werejrgpon 

ygptrp achieving or have achieved 
_ Jemic Coals 

grease my knowledge and 
inderstanding in an academic field 
Obtain acertificateor degree 
complete courses necessary to transfer 
to another educational institution 



Career-Preparation Coals 
To discover career interests 
To formulatfj long-term career plans and/or , 
goals , . .. 
To prepare for a new career* 

nthpr ■ • ■ . "" • — . — S — 

job- or Career-Improvement Coals , 

To iimprove my knowledge, technical skijls, 
anc/or competencies in my job or career 
To increase my chances for a raise and/or 
promotion 

Hfhpr ■ ' • ■ 



Social- and Cultural-Participation Coals . 
To become actively Involved in student life 
and campus activities 

To increase my participation in cultural and 
social events 
To meet people 

Other _^ ^ — ^ 

Personai-Dovelopment and Enrichment Coa Is . 
To Increase my seif-confidence 
" To improve my leadership skills ■ 
To improve my ability to get along with others ; 
To learn skills that will enrich my daily life. V 
or make me a more complete person 
To develop my ability to be independents , 
. self*re|iarit, and adaptable ^ 

U- Other 1^ ^ 



8. From the list of goals in question 7/ please select the 
• three that were most important to you when you 
attended our college. For example. If your most 
. important goal was "To obtain a certificate or degree," 
enter the letter B in the first box. 

• Mostr— 1 Second Most pn Third Most [—] 

• ImfXjrtantL—J Important! I Important LU . 

131 132 13J 



9. What degree were you seeking when you attended our 
college? 

pO Not seeking a certificate or degree 

1 Ceitificale of one year or less 

2 Certificate of more than one year 

3 Associate degree 

-4 Other 



10. a. Please write in your major or area, of study at our 
college. 



13. What^was^your primary enrollment status when you 
attended our college? 

-0 Primarily for credit— full-lime(12 or more hours 

each term enrolled) 
1 Primarily for credit— part-time(less than 12 hours ' 
each term enrolled) 
1-2 Primarily not for credit 



While you were enfjg; 
normally work V 

0 I was not en 

1 Employed! 

2 Employe 

3 Employed 
■4 Employed 36 P 



many hours did you 
f we re bei ng he I d ? 



Ijassisfance (loan or scholarship) 



eive It 

ire I found out if I received it 



.11 




b. Now look at List-A: Majors and Areas of Study anc^ 
enter in the boxes below the code number of tj 
category in which your major or area of study falls. 



ision to leave a particular college can be 
jvated by a variety of reasons. Please circle the letters 
the reasons that contributed to your decfSion 
mir college: 

ic Reasons - . - 



. a. Was our college your first choice? 
r 0 Yes ' • ■ 



b. If no, what kind of college was your 
—0 A public two-year coi 
.1 A public four-ye 
2 A private co 
3. A vocational/te 
nursing, trade 

4 Other 

What was the name of l1 
choice? 




Achieved my acaidemic goals 
Transferred to another college 
Needed a break from college 
Courses/programs I wanted were not available 
Dissatisfied with my academic performance 
Dissatisfied with the quality of teaching 
Dissatisfied with the learning environment . 
Course work not what I wanted 
Unsure of my academic goals 



Financial Reasons 



155 K Did not have enough money to continue 
1SG L Could not obtain sufficient financial aid - 
157 M Could notearnenough money whileenrolled 

15.^ N Other ' ■ • 

Other Reasons 









D 




E 


. 150 


F 


151 


C 


152 


H 


153 


i 


154 


J 



12. Whl 

poln' 

i,3;o6to2. 

141- 2 2.00 to1.l 
3 1.00 or less 
»-4 Unknown or did not have one 



lat was your overall grade 



15" O- Achieved my p^^rsonal goals 

»o P Accepted a job or entered the^military 

1G1 ■ Q . College experience not what.1 expected 

1 G2 R Few peop I e 1 cou I d ide n tify ! with ; 

163 S Moved out of the area ■ . 

164 T Could not work and go to school at thp same time 

165 U Other responsibilities becameULoo great 

166 V Personalproblems ' ^ 

167 W Drher/ ' ' ■ ■ 
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17. From the list of reasons in question 16, please select 
the three most important reasons and enter their codes 
belovy. For example, if the most irpportant reason was 
that you "Transferred to another college," enter the 
tetter B in the first box. 

Third Most | — I 
, Important! — I 

170 



Most |— I 
Important I I 

166 



Second MostrTl 
Important! J 

169 



18. The following are services provided by colleges. How 
would you evaluate these services as provided by our 
'college? For each service^ circle the number of the 
responsethat is most appropriate, 

I did not know about this service 

I knew about this service but did not use it 

I used this service and was satisfied with it ' 

Ii used this service but was not satisfied with it 
i ■ ■ '. 

0 12 3 Admissions 

0 12 3 Registration 

0 12 3 Business office 

0 12 3 Academic advising 

0 1 2 3 Guidance, Counseling, and testing 

0 12 3 Reading, writing, math, and study-ski Ij 
improvement 

3 Tutoring 

3 Minority affairs 

3 College cultural progranis 
3 • Recreation and athletic pr^i 

3 Financial aid , 

3 Student employment 

3 Career planning • ; 

3 , |ob placernent 

3 Housing service^ 

.3 Cafeteria 

3' Health servi( 

3- Library 

3 Child c 

3 Book 
3 
3 



171 
172 
17j 
174 

176 

177 
178 
17y 
1H0 
181 
182 
18 1 
18*1 
185 
18f- 
187 
188 
1H9 
VH) 

lyi 

Vii 



1 
1 
• 1 
1 
1 
'1 
1 
1 

0. 1 2 
0 12 
0 1 
0 1 
0 1 
0 1 
0 1 
0 1 



193 0 1 2 3 

19. a. Do you curi 

-0 No, not at this 
1 ^^^(iPlan to reefl 
2^|^^^^ealreadvl 

jfaAkmcpN 

Sm c 




ollege 

t another college 
er college 
J about any additional 



^ fses '2 or 3. please write in the 
^e you plan to attend or are 



ADDITIONAL QUESTIONS SECTION 

Additional qyiistions may have been added to this 
printed forrp by yiuur college, if you liaVe been asked : 
to. answer additional questions, please use the boxes 
below to record your responses. • 



below for . any comments, you ,have 
lis questionnaire, or anything else you 




□. 


□ 


23 


24 








□ 




29 


" 203 


204 


□ 


□ 


33 


, 34 


20B , 


20'). 



4 



934ir)OOO00045400 
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LIST A: MAJORS AND AREAS OF STUDY 

Programs usuaify requiring four or more years of study 



0100. 

0200 

0300 

0400 

0500 

0600 

0700 

0800 

0900 

1000 

1100 

1200 

1300 

1400 
1500 

1600 
1700 
1800 
1900 

2000 
2100 
2200 

2300 
4900 
6000 
7000 



Agriculture and Natural Resources 
Architecture and Environmental Design 
Area Studies (includes Asian Studies, Black Studies, etc) 
Biological and Life Sciences • 
Business and Management 
Communications ■ 
Computer and Information Sciences 

Education ; , . .i-Wf^*^ 

Engineering " ' ' ^ISF^^ 

Fine and Applied Arts (includes Art. Dance. Drama, MusiCi'Jetdi), 
Foreign Languages /'^I^JiSSpj 
Health Professions 

Home Economics (includes Clothing and Textiles, Institutiohaj^ 
Housekeeping, arid Food Service Management, etc) 



Law 



Letters (includes Creative Writing, Literature/5jv''^^^P^y' 
Speech, etc) 

Library Science '^^^ 
Mathematics 



Military Sciences ^^^^^^^ 
Physical Sciences (includes Chenriisjtr^^^j5fcs, Earth-S^^^ 
Sciences, etc) " 
Psychology 

Public Affairs and Social Serv^S 
Social Sciences (includes -^QMlifP^,^ 
History, Political Sciehce^ocipT*^^^ 
Theology and Religion ^ 
Interdisciplinary Studj^ 
Other 

Undecided but prot^|aigjggJi|g^^ 



Prograrrls i^5ua//y^>^iy^ 




r ■ 



^^&t'^r years of study 



5000 



Business 
Bankjng;, 
etc;) 

Secf|tar|aIJecHi 




_ es (includes Accounting, 
sfahd RestaurantManagoment. 



jrient, Ste 
rviGeTechi 




des Office Supervising and - 
nd typing Technology, , etc) 
(includes Stewardess training, 



5506 
8000 
9000 



Slogies (includes Computer 
^chingretc. ) 

rParamedlcail Technologies (includes 
S^l Assistant Technology, LPN, Occupational 
rherapy Technology, etc). . 
nd Engineering Technologies (includes 
fand AutornotiveTechnology. Welding. 
, Architectural Drafting, etc) 
^^^truclibn and Building Technologies (includes Carpentry, 
riurnoing. Sheet Metal, Heat^ 

^mjfal Science Technologies (iricludes Agriculture Technology, 
^Tronmental Health Technology, Forestry and Wildlife 
gtechnolbgy, etc) . ' * . 

^Food Services Technologies (includes Food Service . ^ 
Supervising, Institutional Food Preparation; etc) ' 
Public Service technologies (Includes Law Enforcement 
Technology, Teacher Aid Trairiing,:Fire Control Jechnology, 
Public Administration Technology ^etc.) - 
Recreation and Social Work Related Technologies 

Other' ,, ^r'' ^;,;:'';::.:' " . ■ ' ; 

Undecided but probably less thain four year program 
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J bo not complete this sec 



usT r~i I I 

NAMI I I II . 
AMY O I MLR NAME. WHICH M 

.SI ubi; N r id'i.n r if i'cat ion n 
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Former-Student 
Qjjestipnnaire 



(Four-Year Institutions) 



:tion 

d to do so. Please print. 



riRST 
NAME 



MIDDLI 
, INITIAL 



1-12 

DL OR COLLL-Ci: RECORDS . 



□ 



. TELEPHONFNUMHER . 



31^55 



lystems ^ 
> Board 



Student-Outcomes Information Services 
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STANDARD QUESTIONS SECTION 



INSTRUCTIONS: 

Specific directions are given for completing many of 
. the questions in this questionnaire. Where no directions 
are given, please circle the number or letter of the 
most appropriate response. Such as in the sample 
question below. 

Sample: 

4. Are you currently married? 
0 Yes 
©No 

If you are not currently married, you would circle the 
number 1 . 



1. What is your sex? 

j~0 Female 
^^i-l Male 



2. How do you describe yourself? O'rc/e one. 
-0 American Indiari or Alaskan Native 

1 Asian. Pacific Islander, or Filipino 

2 Black or Afro-American 

3 Hispanic, Chicano. or Spanish 

4 White or Caucasian 



>5 Other 



3. How old are you? 
-0 Under 18 

lolS to 22 years 
2 -23 to 25 years 
.3 26 to 30 years 

4 31 to40yeai 

5 41 to 

6 5.1 to 
"7 61 ye; 

4. Are you currentjy 




ve a permanent handicap? 



bbility * 
'd hea/ing 
ctccJ vision 

prefer not to record it on this form 



6. How long did you attend our college? 
f-O One term 

1 One year • 

2 Two years 

3 Three years 

4 Four years. ^ 

5 Five years 

6 Six years 
^7 Moretha 



■ / 



7... The foliowij 
students 
of tho$i^ 
aflende&^j 
letters of 
achieved as a 





efle^^ljegoals of many college 
(rase crc/e the letters 
f to I you when you 
'hnd column, circle the 
are achieyin^ or have' 
ler/e n ces a f ou r c o// ege. ^ • 

me / 

m achieving or have achieved 

ic Goals . / 



12^ T. 128 T 



icrease my knowledge and 
erstanding in an a^cadeniic field 
btain a certificate or degree ; • '■ 
To complete courses^^necessary to transfer 
to another educational irrsmution i 

Career-Preparation fcoals 
To discover career interests 
To formulate long-term career plans and/or 
goals 

To prepare for a new career 
nthpr : 

lob- or Career-Improvement Goals ■{ 

To improve my knowledge, technical skills, 
and/or competencie.s in my lob or career : ; 
To increase my chances for a raise and/or ' 
promotion j^^^^^ / 

nthpr . : 

Social- and Cultural-Participation Goals 
To become actively involved in student life ? 
and campus activities . ' 
M To increase my participation in cultural and 
social events 

To meet people ^ 



Personal-Development and Enrichment Goals 
To increase my self-confidence 
To improve my leadership skills r : ; 

To improve my ability to get along with others 
To learn skills that will enrich my daily life 
or make me a nriore. complete person 
To develop my ablJity to be independent; 
self>reliant, and adaptable 1 • 



87 5 Other. 



)29 ^ U 130 U Other;_ 
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8. from the list of goals in question 7, please select the 
three that were most important to you when you. 
attended our college. For example, if your most 
irriportant goal was "To obtain a certificate or degree," 
enter the letter B in the first box. 



Most r — I 

Imrx5rtnht L I 

131 



Second Mosti — i 

Important! I 

132 



Third Most I — I 

Important L I . 

133 



9. What degree were you seeking when you attended our 
college? 

pO Not seeking a certificate or degree 

1 Certificate 

2 Associate degree 

3 Bachelor's degree 

4 Master's degree 

5 Specialist degree (e g , Ed.S ) - ■ 

6 Professional degree (e g?, medicine, law, theology) 
-7 Doctoral degrce(e.g., Ph.D., Ed.D , D.B.A.) 

10. a. Please write in your major or area of study at our 
college. ' : 



b. Now look at List A: Majors and Areas of ^tudy and 
enter in the boxes below the code number of th^ 
category in which your major or area of study I 



IT. a. Was'our college your first choice? 
pO Yes 
M No 
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b. If no, what kind oH^I lege 
-0 A public two-year 
' 1 A public four-year 

2 A private col leige.6r 

3 A vocational/tech 
nursing, trade sc 

^4"Other 

What was the 
choice? 



12. When 
point avi 
nO 4.00 to 
T 3.00 to;2.01 
141- 2 2.00 to 1.01 
3 1.00 or less 
-4 Unknown or did not have one 



13. What was your priniary enrollment' status when you 
attended our college? ' 

pO Primarily for credit — full-time (12 or more hours , 
each term enrolled) ' ^ ' ' '\ 

142- \1 Primarily for credit— part-time (less than 12 hours 
each term enrolled) 
-2 Primarily not for credit ; 



14. While you were enroll* 
normally work when 
pO I was not empl 

1 Employed 1 

2 Employed 1 

3 Employed 21 
-4 Employed 36 hours 



15. Did 
whil 



ny hours did yoii 






nee (loan or scholarship) 



ound out if I received it* 



to leave a particular college can be 
a variety of reasons. Please circle the letters 
masons that contributed tooybur decision 
liege ' ■ 



d my academic goals 
>Transf erred to another college 
Needed a break from college ' , 
Courses/programs, 1 wanted werpnot available 
Dissatisfied with my academic performance 
Dissatisfied with the quality of teaching 
Dissatisf ied.with the learning environment . 
Course work not what (wanted 
Unsure of my academic goals 



Financial Reasons 

K Did not have enough money to continue 
L Could hot obtain sufficient financial aid 
M Could not earn enough nioney.while enrolled 

N Other ■ ' ■ ' ' 



Other Reasons 



Achieved my personal goals 
Accepted a job or entered the military 
College experience notwhat I expected 
Few beople 1 could identify with 
Moved outofthearea. 

Could not work and go to school at the same time ! 
Other responsibilities became too great 
Personalproblems • 



167 W Other 



17. F,rom the list of reasons irTquestion 16, please select 
the three rnost Important reasons and enter their codes 
below. For example, if the most important reason was 
that you "Transferred to another college/' enter the 
letter" Bin the first box. 

Most [— I Second Most pn Third Most p— | 
Iniportant LJ Important l_l ; Important L_J 
1(>8 I6g '170 

18. The following are services provided by colleges. How 
wpuld you evaluate these services as provided by our 
college? For each service, circle the number of the 
response that is most appropriate, ^ 

I did not know about this service 

I knew about this service but did not use it 
I use'd this service and was satisfied with it 
I I used this service but was not satisfied with it 



.171 
172 

m 

174 
175 
176. 

177 
"l7fl 
17«J 
180. 
1»1 
182 
18.1 
184 
; 185 
■18(> 
" 187 
188 
189 
I'JO 
I'JI 
192 



0. 1 
0 1 
0 1 
0/1 
0 1 
0 1 



0 1 

p 1 

0 1 

0 1 

0 1 

0 1 

0 1 2 

0 12 

0 1 2 

0 1 2 

0 1 

,0 1 

0 1 

0 1 

0 1 



3 
3 
3 
3 
3 
3 

3 
3 
3 
3 
3 
3 

2 3 • 
3 
3 
3 
3 

2 3 
2 3- 



Admissions 
Registration 
Business office 
Academic advising 
Guidance, counseling, and testing 
Reading, writing, math, artd study-skills 
Improvement 
Tutoring 
Miriority affairs 
College cultural programs 
Recreation and athletic progra]^ 
Financial aid 
Student emplovment 
Career pla fining. 
. Job placement 
Housing services* 
Cafeteria 



Health services 
Library 
Child care 
Bookston 
Parkin; 
Cami 



193 0 1 2 3 



19. a. Do you curren 

-0 No, not at this time 

1 Yes, Mfl|fl|to reen 

2 Ye^^roiMt ready enro 

3 :y^^B^jBcnDlls£Lt a 
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Dbut any additiona 



2 or .3, please write in the 
you plan to attend or are 



ADDITIONAL QUESTIONS SECTION 

Additional questions may have been added lo'this 
printed form by y bur college. If you have been asked 
to answer additional questions, please use the boxes 
below to record your responses. 





the^!iS|B|Mifew. for any comments you have 
colIeg^raMxiuestionnaire. or anything else you 
ire with usr^ 



attend ingj 



g34160()O00045400 
10M;279:LP:Rob:2HA309 
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LIST A: MAJORS AND AllEAS OF STUDY " 

Programs usually requiring four or more years of study 



0100 Agriculture and Natural Resources 

0200 Architecture and Envir6nmental Design 

0300 Area Studies (include^ Asian Studies; Black Studies, etc.) 
0400 . Biological and Life Sciences 

0500 Business and Management ' • 

0600 Communications 

0700 Computer and Information Sciences 

0800 Education ' • 

0900 Engineering . , 

1000 Fine and Applied Arts (Includes Art, Dance, Drama, Mu^ 

1100 Foreign Languages/ 

1200 Health Professions 

1300 Home Economics (includes Clothing and Textiles, Institution 

Housekeeping, and Food Service Management, etc.) 

1400 Law 

1500 Letters (includes Creative Writing, Literatur 

/ Speech, etc.) 

/1600 Library Science 

1700 Mathematics 

1800 Military'Sciences 

1900 Physical Sciences (Includes Chemi: 

Sciences, etc.) 

2000 Psychology 

2100 Publics Affairs and Social ServJ 

2200 Social Sciences (includes Ac 
. History, Political Sciencej^c 

2300 Theology and Religiori 

4900 Interdisciplinary Stiid^ 

bOOO Other 

7000 Undecided but proi 



Progratms usually, 





5506 
8000 
9000 



ftloPes (includes Accounting, 
ITand Restaurant Management, 

udes Office Supervising and 
nd Typing Technology, etc.) 
ftes (includes Stewardess Training, 

flogies (includes Computer 
c King, etc.) 

a r a m ed i ca 1 Tec h no 1 og tes ( i n cl U des 
sjstantTechnology, LPN, Occupational 
[herapy Technology, etc.) 
nd Engineering Technologies (includes 
Fand Automotive Technology, Welding, 
^ , Architectural Drafting, etc.) 
truction and Building Technologies (includes Carpentry, 
"ping. Sheet Metal, Heating, etc.) , ' 

fal Sclence Technologies (includes Agriculture Technology, 
ffronmental Health Technology, Forestry and Wildlife 
Bchriology, etc.) 

1 Services technologies (includes Food Service 
Supervising, Institutional Food Preparation, etc.) 
Public Service Technologies (includeis Law Enforcement 
Technology, Teacher Aid Training, Fire Control Technology, 
Public Administratipn technblogy, etc.); 
Recreation and Social Work Related Technologies 
Other \ 

Undecided but probably less than four year program > 
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Planning Chart for Survey Activities US, 



ACTIVITV 



PERSON/OFFICE 
RESPONSIBLE 



TARGET 
DATE 



Decide on the objectives of the survey and the specific study 
questions to be answered. 

Meet with a committee of potential users of the survey to discuss 
and if necessary modify survey objectives and study questions. 

Finalize study objectives and prepare a schedule for survey 
administration. 

' '.. . ^ . ■ 

Study the appr9priate questionnaire to ensure that it will provide 
'data appropriate to the survey objectives. 

/' • ' • . ^ 

Decide «m an^appropriate sampling strategy. / 

Establish a method for identifying theStudents in the sample (total) 
population to be surveyed. . ' 

Decide on a method for distributing questionnaires. 

Produce a complete list of those to be surveyed; if using a 
computer to generate the list, also generate a computer file 
containing all students to be surveyed..;. 

Prepare all survey materials for distribution (questionnaires, cover 
letters, follow-up materials, mailing envelopes, return envelope^^ 
postage, address labels, 'tracking sheets). . - ^ • 



10. Prepare a set of follow-up procejiures. 

11. Administer of mail out questionnaires^. 

12. As returns are. obtained, maintain trackmg sheets, implement 
appropriate follow-up procedures. « * 

13. Edit and code returned questionnaires; prepare for submission to 
SOIS Que5:tionnaire;Analysis Service. 



. . 2. 

,3. 

4. 

5. 
6. 

7. 
8. 



Integrate data with institutional master-file data. 



14. 

15. Document analysis printouts. ' . 

16. Prepare initial reports; m'eet with users committee on results 
obtained. 



17. Resptm to requests for Information on demand. 
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Using the 
SOIS Qtiestioimaire-Analysis Service 



A considerable problem in conducting a student-survey is the need to develop, an 
analytic framework and computer software to facilitate analysis of the data collected. 
Many colleges and imiversities are prevented from conducting effective studies 
because they lack th^qiwiified personnel o^ resources to support these activities. To 
meet this need, SOIS includes procedures that can provide analyses of the ; 

student-outcomes questionnaires. The procedures j^provide an institution withi^a 
ready-made analysis package that contains frequency and^percentage distributions 
for every item as well as appropriate means, ^^medians, and standard deviations; 
cross-tabulations of most items showing differential responses, for 'subgroups of 
respondents; comparative, suinmary data from questionnaires collected by other^-^ 
similar institutions that have participated in SOIS; and, perhaps most importantly, 
quick turn-around for processing questionnaires. SpeciflGallyj^ the SOIS analysis 
service can: 

^ ■■ • t ^ • 

• Keypunch the questionnaires collected by the instituflbn 

Perform computer analyses using the standard QUEST analysis system 
: developed by the College Board 

• Provide an easy-to-read, computer-geriera ted report for each question- ^ . 
naire, including statistical tables that can be inserted into locally 
produced interpretive reports 



• Provide comparative report^ summarizing the responses of students at 
other institutions using the SOIS Questionnaire- Analysis Service 
(Program Profiles) ■ . 

• Provide a computer tape of coded resources for fiirthei;' institutional 

"analysis i 

, 1 • 

i 

SOIS procedures for analyzing the questionnaires thus provide institutional 
administrators with a quick, inexpensive, and simple way of conimunicating survey 
information to various ciampus and community audiences. . 

Preparing Questionnaires for Analysis | 

SOIS questionnaire-analysis procedures are initiated after thejlocal sm-vey coor- 
dinator has administered the questionnaires,' collected the conipleted forms, and 
inspected them to ensure an acc°eptable level of accuracy and completeness. The' 
procedures end when a comiSuter-produced analytical report is rnailcl back to the 
institution, usually withiri twowtfeks of receipt at the College Board. 

To ensure that students have followed directions and that no inconsistencies ' 
have occurred in the kinds of responses received for each questionnaire, a few , 
returned questionnaires should be examined. This is especially important if local 
questions have been added to the questionnaires. In some instances, the adminis- 
trator may discover problems that can be corrected through hand coding a particular 
response before forwarding the questionnaire for analysis. In other instances, an 
inspection of the questionnaires before keypiinching m-ay reveal problems that can- 
not be corrected but that can be discussed in the interpretive report. 
. SOIS questionnaire-analysis procedures assume that all student responses have 
. been made in a format that can be keypunched without ftirth^^ editing or coding. 
The standard questionnaires are designed so that all responses^ are made in such for- 
mats: If local questions have been added, however, the administrator should verify 
that they have been correctly entered in the Additiprial C^iestions section of the 
questionnaire. Some local questions may require that students write their responses 
directly after each question. For these responses to be included .in the computer 
analyses, the local administrator will need to code them in the appropriate-box of the 
Additional Questions section of the form; (Remember that the number of responses , 
to each local question is limited to ten arid that they must be coded; MMwe^^ 

• Any hand coding should be performed by a person who has been given explicit 
coding instructions. The coder should be told to set aside any questionnaire for 
which there is an ambiguous response so that the survey administrator can decide 
how to code it. 

In any questionnaire survey, mistakes by hand coders or by students who, 
. misread directibns are bound to occiir in recording responses. Editing^thg^queStion- 
naires before they are submitted forianalysis can' detect twobasic-kinds of erro^^^ 



\ 



2. 



Responses may be out of tjheac^^eptablevTange for an item. For example, 
one or two students may be shovm lo have sex codes of "3" when only 
"0" and are valid respphses. The stmcture of the questionnaire 
makes such coding and respon)5;e ^^'.rrors in standard questions relatively 
rare, but they will occur irore frequently on local items. 
Contradictory responses may exist among pairs or sets of responses. An 
example of such a contnidictioA^ occurs when a sophomore student 
indicates that the cw?r^wr c.egree b^ing pursued is a* doctorate. In many 
casesi these errors origiriate or auestioimaire itself (that is, a 
student misunderstood an item In such cases, the survey adminis- 
trator must decide which respo correct; those responses that 
contradict must be changed to blanks\or **no response" on the appro- 
priate card coli^mns. 



How to Use the Batch Transmittal Form \ 

■ ■ . : U ■ ■ I ' ■ ' ■ ..\. ■ . ' : . 

After the completed questionnaires have been inspected and any necessary hand 

coding performed;, they should be securely bundle^^ together with a fully coinpleted 

Batch Transmittal Form, and f(|'rwarded to \ 

SOIS Director / 
College Board 
888 Seventh Avenue 
New York, New YorW 10019. 



In order to insure against loss of the questionnaires in transit, it is best to'send 
them by registered mSil or with a return receipt ripquested, . A ^sample Batch 
Transmittal Form is shown in figure C. l. Each institutidn participating in SOIS will 
be provided with a copy of this form when its questionnaire order is filled. A separate 



Batch Transmittal Form must 



be submitted fpr every type of questionnaire and for every 



administration of a questionnaire for which a separate aijalysis is ^desired 



For example, three separate Batch Transmittal Forois must be completed if an 
institution (l)has administered the Entering-Studerit Que'stionnaire to new students 
in the fall, winter, and spring quarters; (2) is transmitting) all three administration's 
questionnaires to the College Board at one time; and (3) djesires separate reports for 
.each entering student group. Similarly^ if the ^ institution has administered the 
Entering-Student, Formerr'student, and Program-Gompleter/Graduating-Student 
questionnaires and is forv^arding all three at one time, separate Batch Transmittal 
Forms must be eompletedf In addition^ if more than one institution or more than one 
campus of a single institution is submitting questionnaires at one time, and if 
separate analyses are desiired, separate Batch Transmittal Forms must be completed: 
The. Batch Transmittal Form request! the following ik^^ 



EKLC 
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FIGURE CI 



Questionnaire Batch Transmittal Form 



NCHEMS-CoHese Board 
Student-Outcomes Information Services 



Questionnaire Batch transmittal Form 



institutional Study Identification Number (for College Board use only) 
Type of Questionnaire Administered (Complete a separate form for each type of questionnaire) 



5 b 



4 - Private four-year 

5 ^ Propriet uy 

6 - Other 



CODES f OR THE 

' , 2-Ycar Scrirr 4-Ycar Series ^ 

Entering Student 21 ■ 41 

Continuing Student \ 22 42 

Program Completer/Graduating Student 23 43 

Former Student \ 24 . 44 

Recent Alumni - \ 25 45 

Long-Term Alumni 26 46 

Date Questionnaires Were Administered 

Type and Control of Institution 

1 - Public two-year ■ 

2 - Public four-year 

3 - Private two-year 

Carnegie Designation of Institutional Type 

1.1 - Research University 1 

" . 1.2 - Research University II 

1.3 ~ Doctorate Granting University I 

1.4 - Doctorate Granting University II 

2.1 - Comprehensive College or University 1 

2.2 - Comprehensive College or UniversJty II 

3.1 - Liberal Arts College 1 

3.2 - Liberal Arts College II 

4.0 - Two-year College or Institute ; 

5.1 - Theological Seminary or Bible College 

location of Institution (Postal Service State abbreviatiori) 
Number of Questionnaires in this Batch „ ■ • 

Keypunching Instructions: (Use A, B, or C, as appropriate) 

• Keypunch questionnaire data and: , " ... 

A. Student name, address and I.D. number (Cost: 35<t per questionnaire) . 

B. Student I.D. number only (Cost; 254 per qOestionnaire) 

C. No student I.D. information (Cost:..17(r per questionnaire) • , 

Keypunch as per choy/c with Key Verification (Cost; double the prices listed above) 
. . (Y - Yr:s. 'v: N9) • • ' ■ 
Should tape c;»4r.4 be produced at $50 per tape? (V - Yes,.N - No) 
Trnrk ^_ __Density_ 



H I I I I \'U 2 
MO DAY YEAR 



5.2 - Medical School or Center 

5.3 - Other Separate Health Professions Center 

5.4 - School of Engineering or Technology 

5.5 - School of Business or Management 

5.6 « School of Art, Music, or Design ^ 

5.7 - School of Law 

5.8 - Teachers College 

5.9 - Other Specialized Institution 

6.0 - Institution for Non-Traditi^nal Study 

6.1 No Carnegie'Designation 



■ Extra copies of the report are available at $20 pjer copy. Enter number of copies ^ired 

Should questionnaires be returned to institution? (Y - Yes, N - No) 
(You will be billed for mailing costs plus handling charges of $10) 

> NTumber of local queriions added (Please attach a copy of your local questions); 

SOIS Questionnaires submitted by: 

My^p . ' ' • , """" — ^'^'^ 



Institution 



Mailing Add "ess 



I I I .1 I I I I I I I M I I I I - I'TT 



Telephone Number . 



. Signature. 



Mail completed Transmittal Form with SOIS Questionnaires to: . 

^' SOIStCoordinatoo.College Board, 888 7th Avenue, New York, N.Y. 10019 
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□ 
□ 



Institutional Study Identification Number. This number is used to iden- 
tify difFerent institutions or difFerent campuses for which both, indivi- 
dual and group reports are to be prepared. If the questionnaires have 
l^een adpinistered as part of a larger, prearranged group study^a special 
identififcation number will have been. assigned to the institution by the 
study administrator. If the institution, on its own, is siibnutting , ques- 
tionnaires from niore than one c^nipus or administrative unit and 
wishes separate analyses, different numbers should be assigned to iden- 
tify the different entities. In planning studies siich as those described 
above, it is essential that prior arrangements be made with the Director 
of SOIS Data Processing to assure accuracy in the reporting of resiilts. 
' Type of Questionnaire Administered, The individual questionnaires in 
the different series have different questions and thus require different 
analyses. The questionnaire identification number ensures that the 
correct analysis package is used for the type and series^of questionnaires 
included in the batch. (Note again that separate Batch Transmittal 
Forms niust be completed for each -different kind pf questionnaire sub 
mitted for processing and. analysis.) 

Type and Control of Institution. Eriter the code . number . that 'best 
describes tKe kind of institutipn at which the questionnaires have been 
collected. The code entered here will be used to aid preparation of 
Program Profile comparative data reports. \ 
Carnegie Designation of Institutional Type. Enter the code nuxnber that 
best describes the kind of institution at which the questiorinaires have 
been collected* The code entered here will be used for inte/^i^al research 
purposes and for developing additional comparative d^i^a in subsequent 
years of the service. 

Location of Institution, Enter the Postal Service two-ictt^^r cod'^: iden. :fy- 
ing the state in which the institution is located. (For raaF.ple, CA for 
California, NY for New York.) If the instttution has campuses \r more 
than one state, enter the code for the state in which the primary campus 
or a^irfnistrative center is located. The code wtered here VviL also be 
useci fpr internal research purposes and for developing additional co.m- 
parative data in subsequent years of the service. 
Approximate Number of Questionnaires in Batch. The number (entered 
here will be compared with the number of questionnaires keypuJiiched 
to ensure that none is lost in transit. 

' Return df Questionnaires. Upon request, the College Board will return 
the questionnaires to the institution after keypunching and analysii;. i-iii 
additional charge for return postage and handling will be included: with 
the analysis costs. 



• Submitted By, Provide the name; address, and telephone number of the 
person, to whom questions about the desired analyses should be directed 
(if necessary) and to whom the computer-produced reports should be 
forwarded. */ 

I. ' 

Multiple copies of the compuier-generated report, which typically can be pro- 
duced le.^s expensively at the time the report is generated, may be obtained through 
th^ BatcJi Transmittal Form. Computer tape output can also be provided in a variety 
of track/densiiyo formats. Such output can help an institutiuo perform subsequent 
detailed analyses or different analyses as local needs and interests dictate. . , 
* . ■■ ' 

Outputs of the Analysis Service f 

The standard output of the SOIS Questionnaire-Analysis Service is one cqpy of a 
computer-generated report for each group of questionnaires for which a Batch 
Transmittal Form is submitted. Each' item, in the standard questionnaire will .be. 
identified with^ appropriate textual statenients. The number and percentage of 
students indicating each response will be identified. Means, medians, and standard 
deviations will be provided for questions with appropriate numerical response 
values. 

Local questions coded in the Additional Questions section will be identified only 
as local question 1, local question 2, and so forth. Responses to the local questions 
will, be identified only by the code number or letter entesed in t|ie response box. 
Frequency and percentage distributions will be provided, but no means, medians, or 
standard deviations will be" calculated. * 

Special analyses and outputs can be provided upon request, with prior arrange- 
ment, and for additional, cost. These include group reports combining responses to 
the same questionnaire made by students at more than one institution or by more 
than one campus or administrative unit that administers - questionnaires at- the 
same time. Multiple group reports can be prepared for difl vnt levels of inquiry (for 
a campus, a multicampus institution, a segment of similar institutions, a geographi- 
cal region within a state,'a state, or a multistate regiofi). Special institutional coding 
may be required to produce meaningful group reports; specific prior arrangements 
with the Director of SOIS Processing at the College Board are advised. 

In addition to group reports, NCHEMS and the College Board can arrange 
other analytic services to meet specific institutional, regional, or state needs. Most 
needs, brvever, should be determined before the questionnaires are administered to 
students. Those interested in special services or analyses should cojpact the SOIS 
pirtceor at NCHEMS (P.O. Drawer P, JBoulder, Colorado 80^02) for special 
services related to survey design or data interpretation, or the SOIS Director af 
College Board (888 Seventh Avenue,. New York, New York 100 19) for special data 
analyses or comparative daita. .x 
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The computer analyses of the SOIS Qilestionnaire-Analysis 3ervice have been 
designed to provide the basic core of information needed for preparing local inter- 
pretive reports. Generally self-explanatory - and easily understood, they dp riot 
require that the user be -sophisticated in research methods or data processing. * 

In the analyses, questions are identified by the same number/letter code that 
appears on the original questionnaire. A table of contents, organized in the same 
sequence as the items in.the original, questionnaire, precedes each analysis. An index, 
arranged in alphabetical sequence by question content, follows the analysis and . 
helps the, user locate specific questions in the output provided, Samples of the first 
pages ,of a table of contents from the Former-Student Questionnaire is illustrated in 
figure C.2. / 



FIGURE C.2 
' Sample Table of Contents for SOIS Analysis 
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In the computer analysis, most items appearing on the questionnaires are cross- 
tabulated by responses to Other items. This permits differential description of 
subgroups of the total student population. Typically, every item is cross-tabulated 
by the gender, marital status, handicapped status, racial/ethnic group membership, 
course load, and age of the respondent. Other special cross-tabulations are provided 
as appropriate for individual items >Figure C.3 gives a detailed presentation of the 
specific cross-tabs provided for the SOIS Former-Student questionnaire. The cross- 
tabs provided in each report are documented in the computer output by a Question 
. Table and a Cross-Tabulation Report, which appear at the end of the report,. 

tinder :jtanding the Computer Analysis 

The bulk of the report provided by the SOIS Questionnaire-Analysis Service for 
each questionnaire consists of cross-tabulations of relevant questions against one 
another. These cross-tabulations enable the questionnaire administrator to directly 
compare the responses of different subgroups of students and to test hypotheses 
about some of the causal dynamics underlying particular responses. It is important 
to stress that a great deal Of useful information. is often contained in a single, cross-, 
tabulation and that each should be examined with some care.\This section will 
explain the contents ofthe computer output itself, while the next chapter will treat a 
number of ways in which the cross-tabs provided can be converted into^useful msti- 

tutional information. ^ j • 

Cross-tabulations are presented in the computer-generated report in the^rder in 
which they appear on the questionnaire. All breakdowns of t^lp respons^s^to a 
particular question by different subgroups are thus- presented in the same part ofs^he 
report for easy reference. The table of contents and index provide immediate access 
to all breakdowns of a particular question. « 

A sample page of actual output from the Former-Student Questionnaire is illus- 
trated in figure C.4. Note that the QUEST analysis automatically interjects appro 
priate text to explicate the material included in the tables. The example is drawn 
from the Four-Vear College, Former-Student Questionnaire, and it presents the 
'responses to Questibn 7A-the "academic .goals" of students entering the institu- 
tion-broken down by sex, marital status, handicapped status, race, full-time/part- 
time ehrollment,'and age. Note that part of the age breakdown is cut off aiid.wiU 
continue on the next page. ■ ^ ' ' • , 

Explanations of different parts ofthe computer output are presented below: 

1. Identification numbers corresponding to the designation ofthe item on 
, the original questionnaire and a prose description ofthe content ofthe 

. item. In many instances, the prose description is too long to exactly 

' * duplicate the original question; the user should refer to the question- ; 

naire for the exact wording. 
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2. Response identificaiion numbers and text for every valid response to the 
original item. As vvith the text for the question, that for the response ■ 

may not exactly duplicate the original on the questionnaire. 
, 3. 707 a«</ per (total and percent) provide the frequency of response 
to each item and the percentage of all responses which that number 
represents . In this case, 1 2 1 responses on academic goals were received 
from those answering the questionnaire. In some instances, the total 
' will reflect the unduplicated number of respondents to the question- 
naire. For those questions that allow multiijle responses (as this 
question does), the number ' will reflect the number of individual 
responses to the question,, a number that will probably exceed the 
■ number of individual respondents. In either case, the percentage 
reported will be the percentage the number of responses represents of 
the total reported at the end of the column. 

The TOT and PCT columns appear only once for each item, 
before any subgroup breakdowns are presented. In subsequent 
analyses of that item using difierent cross-tabulations, the JOT and ■ 
PCT columns are blank. 

4. Cross-Tabulation Rows report the number and percentage of 
respondents answering both questions (broken down by th^ answers 
that they gave). For example, eight respondents who described them- 
selves as white also indicated that they had an academic goal involving 
an increase in knowledge . and understanding. Those eight white 
students represented 17.8 percent of all students who identified that as 
one oftheir goals. In many cases, adjacent cross-tabulation columns are 

, - riot mutually exclusive, because they are responses to different 
questions (as between other ethnic background and the fiiU-time class 
load). In those cases, the calculation of raw percentage begins again 
with the first column of the new grouping. ' - 

5. Cross-Tabulation Column Percentages , art given in parentheses 
immedinrely below the row percentages (XX.X).. These show the 
percei that the number of respondents iiuhat row represents of all 
students in the column. For example, the eight white students who said 
they had as a . goal the increase of knowledge and understanding 

i ' represented 32.0 percent of all white students responding to that 
question; 

• ■ It is impoTtant to emphasize that the row and column percentages presented in 
the analysis report giye<quite distinct .but equally usefi^l pieces of information. For 
exa^ipie, the 1 5 married students who responded that an academic goal was to com- 
. plete high-school requirements represent a high proportion (88 .2 percent) of those 
who had this goal (see 6 in figure C.5). Yet these 15 responses represented only 23.4 
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percent of the acudcmic goals of married students in general. The first statistic (row 
percentage) will alert Ihe manager of a stt^lfent-retention .program, for example, to 
the probability that most withdrawing students who had this goal will be married, 
The second statistic (column percentage) will report to others* the fact that this goal is 
only one of several approximately equal academic goaU of married students; Indeed, 
in comparison with the column percentages for withdrawing unmarried students, 
the goals of withdrawing married students areoquip distinct (a clear rhajority of 59.6 
percent of unmarried students respond that their academic goal is "to increase 
knowledge and understanding*'). Thus row and column percentages are equally 
important to the analyst but for quite different purposes. 

Output Documentation 

Accompanying each report produced by the SOIS Questionnaire-Analysis Service is 
documentation on how the data were organized for computer analysis and on how 
the cross-tabulations included in the report were prepared. This documentation is 
contained in two tables— the Question Table and. the Cross-Tabulation Repoft— 
which appear at the end of each report immediately following the index. The 
purpose of this appendix is to briefly describe each of these tables, and to show how 
the information contained in them can be used in designing further local data 
^ analyses of the output tapes that can be provided by the analysis service. 

The Question Table - 

The Question Table illustrates how data from the original questionnaire were 
converted to the QUEST analysis system for processing. (For those who receive tape 
output, the Question Table corresponds to the record layout/or individual student 
records on the computer tape.) A sample Question T&ble is illustrated in figure C. 5. 

^1. QUESTION. This describes the identification, location, length, and 
number of possible responses for each item. Within that section, 

a) NO- is the sequential number assigned to the question for pro- 
" cfessing. In' the Cross-Tabillation Report, this number is also used to 

identify questionnaire iterns. o* * ' 

b) PRT# is a designation corresponding to *the original item on the 
questionnaire. This number identifies the sequence in which items ' 
are printed in the computer-generated output and the actual number 
that precedes that item in the output. ./ . 

c) LOG. describes the starting position of that item in the computer- ^ 
tape record. . ' 

" d) LGTH. describes the number of positions occupied by that item in 

the computer-tape record, 
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e) R# indicates the number of possible responses to that item\jn * 
question 005, handicapped status, for example^ up to six different 
responses can be recorded to indicate students who have /multiple 
handicaps. / ^ 

2. RESPONfSES. This describes coding internal tp the QUEST system 
regarding processing itetns. j ^ ^ 1 / 

3. PRINT This describes the manner in which the analysis pf the item is 
printed (number only, percent only, summary only). 

4. COUNTERS\'Tfiis describes the size of the item'in terms of core 
storage. / \ - " 

5. CROSS-TAB REQUESTS. This shows the number of the cross- « 
tabulations used\ against this item. For.example^ question 004 is 
analyzed using only cross-tabulation 01, while question 070 is analyzed 
with cross-tabulations 01, 02, 03, 04^ 05, 06, and 07. The method of con-^ 

structing these cross-tabulations is described in the following section. , 

^5 ^ ■ I 




Cross-Tabulution Report 

A sample Cross-Tabulation Report from the two-year college, Entcring-Studdnt 
Questionnaire is reproduced in figure C.6. It shows the way in which the cross- 
tabulation columns were prepared, the headings that appear in the cross-tabulation,' 
and the items on which the cross-tabulation was used. Users of the Analysis 
. Procedures will fmd this report helpful in understanding exactly which responses to 
specific questions were used in producing each cross-tabulation. 

1. ALGORITHM, Tfiis indicates the way in which student responses 
were selecfed'fbr inclusion under a cross-tabulation heading. In this 
example, the algorithm 1 001 1 indicates that the responses grouped in 
column 1 (headed iVlALES) were those who answered question 001 
(gender) with a response of OU Sin^ilarly, those whose responses are 
grouped in column 6 (headed HANDICAPPED) are those who 
«? responded to question 005 (do you have a physical handicap?) with 
responses 01, 02, 03, 04, or 05. 
" ,/ . In some cases, student.responses to two questions are used to sort 

/ the responses into cross-tabulation groups. 'In those instances, two , 

' algorithm statements will be connected in the Cross-Tabulation Report 

by the words and or or, arid is used when a student responded to both 
K indicated questions with the desired response; or is used when a desired 
response to either question would result in inclusion. 
'2. HEADING. These are words that appear at the top of the individual 
columns in the cross-tabulations. In many cases, they abbreviate the 
original responses in the questionnaires. The heading HANDI- 
CAPPED, for example, collapses the responses from all types of handi- 
caps (restricted in ability, hearing, vision, and not reported) into a single 
analytical category. 
3. USED ON ..This indicates the individual questions cross-tabulated by 
the algorithm shown. In t^iis example, cross-tabulation 04 has been used , 

on questions 020, 060, 100, 140, and 180. 
Guidelines for Further Institutional Data Analysis 

In many cases, institutions will want to supplement the cross-tabulations produced 
by the SOIS Questionnaire-Analysis Service with data analyses tjf their own. The^e 

. may take the form of additional cross-tabulations not provided by the analysis 
service, 0'" malyses using more sophisticated statistical techniques such as qorrela- 

' lion,, factor analysis or multiple regression, or of subgroup analyses probing the rela- 
tionships between student background characteristics and questionnaire responses 

' within a particular subgroup of students. For example, ah institution might want to 
know if the academic aspiration? of males and females were different for different 
ethnic or age groups within the institution. 

... \\ , ■ ■ 95 ;. ■ . _ „ 
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If questionnaire data are matched with institutional master-file data, many 
kinds of local data analyses are possible. For example, an institution may wish to 
relate .earned GPA and SAT scores to . expressed academic goals and attitudes 
toward the institution. Or the successive responses of a cohort of students to 
different questionnaires as the cohort progresses through the institution can be 
directly related to one another by means of local analyses. 

The most efficient way to perform additional data analyses on SOIS Question- 
naire-Analysis Service output tapes or on merged institutional master-file data sets 
is to use one of the many user-oriented statistical packages available. Three of the 
most widely use3 are:. . ^ ' 

1. Statistical Package for the Social Sciences (SPSS). This package is 
highly user-oriented and includes considerable data transformation 
capability (recodes, and so forth) as well as a wide range of statistical 
packages including cross-tabulation/ correlation, factor analysis, 
multiple regression, and discriniinate analysis. The basic reference is 
Norman Nie, C. Hadlai Hull, Jean J. Jenkins, Karin Steinbrenner, and 
Dale H. Bent, SPSS, 2nd Edition, New York: McGraw-Hill, 1975. 

2. Statistical Analysis System (SAS). This package also provides 
numerous data manipulation and analysis options. A primary virtue of 
SAS^isThatlt can read and analyze data from several differient data files 
simultaneously, eliminating the need for merged data sets with a single 
record for each respondent. The basic reference is SAS Institute, Inc., 
SAS User's Guide, P.O. Box 10066, Raleigh, NC 27605. , 

3. P^57>ir. This package is primarily designed for interactive computing 
and is particularly adaptea for maintenance and transformation of data 
files. It also contains a wide array of statistical-analysis options.- The 

^ basic reference is Shirrell and Rpald Buhler, PrSTAT-78, P-Stat Inc., 
^ RO. Box 285, Princeton, NJ 08540. ' 

Each of the users manuals for these three packages contains not only complete 
instructions on how to use the package but also & brief presentation of the assump- 
tions and applications of particular statistical techniques. The reader is urged to 
consult the manuals in detail. 
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Example or Initial Cover Letter 




21ijux_ .WINDHAM COLLEGE 



rUTNUY.VHRMONT 05346 



. Office oft he Pmidcm 



August 1, 1982 



Dear Fornie.r Student : - . , ■ * • • 

Our institutional records indicate that you. have, not returned to Windham. 
The College is interested in determining the reasons why you left Windham 
and your degree- of satisfaction with vatious aspects of the College. This 
information will be particularly helpfuL in our institutional planning as we 
continu"6 to mebt the x\€<^&5~xsf the students^: — : 



To help us determine this we have enclosed a con f identical questionnaire for 
you to complete. Please complete the questionnaire as soon as-p63sible and 
return it- in the enclosed envelope . You may notice that this questionnaire 
includes personal data about yourself. This is included' in order to verifiy 
our institutional records and for statistixal purposes. This information 
will remain confidential' and your responses will ;become part of bur statis- 
tical -report . 

If you have re-enrolled at Windham, the receipt of this questionnaire in .'O 
way affects that re- enrol Iment » You were merely selected to receive this 
questionnaire because .you were not continuously enrolled at Windham during 
one of "the preceding years. 

./ , , • ■ ' " ■ • ' 

Your cooperation and assistance in completing this questionnaire a? soon, as 
possible is- greatly appreciated. Thank you. ■ 



Sincerely, 




ms/z 



Example of Follow^Up Cover Leiter 



(Date) 



Dear Former Student: • , 

Recently we mailed >ou a confidential questionnaire in which 
we,ask6d*you the reasons why you left (INSTITUTION) and your degree 
of satisfaction with various aspects- of the school. We hatve not 
yet received your response to this questionnaire, ; 

To help us plan for the institution and the needs of. 
students, it is essential . that we receive as many questionnaires 
as possible. 

We are enclosing anothe?* questionnaire for you to complete 
and return to us. If you have already mailed the questionnaire 
to us, please disregard this, second questionnaire. If you have 
not completed the questionnaire, please take a few moments to do , 
so. ThP.nk you for your assistance. 

- ' ^ . " « ■ 

, Sincerely, 
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SnCONt) EXAMPLH OF FOLLOW-Up'COVRR LurmR 



Arnnnhoisi- 5900 south Santa Fe Drive 

>^ ^ II • ' Littleton Colorado 80120 ,\ ■? 

Community college . . 303 / 79^1^550 ^ . ^ 

July 25, 1982 



Dear Former Student: ^fi 



Our institutional records indicate that you did not register 
continuously for the previous year. The College is interested in 
determining the reasons why you'^left A.C.C. and your. degree of 
satisfaction with various aspects of the College. This information 
will be particularly helpful in Qur institutional planning as we 
continue to meet the needs of students. 

To help us determine this we have enclosed a confidential 
questionnaire for you to complete. Please complete the questionnaire 
as soon as possible and return it in the enclosed envelopd. You may 
notice., that this questionnaire includes personal data about yourself. 
.This is included in order to verify our institutional records and. for 
statistical purposes. This information will remain confidential and 
your responses will become part of our statistical report. 

If you have re-enrolled at A.C.C.. , the receipt of this question- 
.naire in no way affects that re-enrollment. You were merely selected 
to rdceive this .questionnaire because you ,v^ere not; continuously 'en- 
rolled E^t A.C.C.. during the 1981-82 school year. 

Your ' cooperation and assistance in completing this questionnaire 
as soon as possible is greatly appreciated. Thank you. 

Sincerely, ' " . 

Leahbeth Barnard 
Director of Counseling 

LB:pk ■ . ' , • ; 
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TO: George GifFord, Vice-President and Chairman 

Student Retention Committee ^ 

FROM: ' Jennifer Piatt, Coordinator for Student Affairs Research 

SUBJECT: Pretention Issues for Various Student Populations 

vThe purpose of tins memo is to present for the Committee's consideration some 
observations on the recently ^-^cnipletedifollow-up studies of Fall 1980 and Fall 1981 ^ 
Entering Students at Sunnyvale Comniunity College (SCC). Although we dis- 
cussed some of these findings in the Committee meeting on March 10 and again in 
the in-service workshop with faculty tl.e next day, I thought it would be useful to set 
dov/n some of the major trends in the data and their implications. 

1. Ge *??ral Patterns of 'detention: - 

The p} mary reason vyhy we embarked vsn the fall series of cohort studies was, of 
coursr., to determine accurately for the first time what rates c-^ attrition SCC \yas 
experiencing. This turned out not to be t?.asy, Itir gely because some information was 
missing from student files and because o f the great variations in types of acadepaic 
programs available. Nevertheless, wp have now tracked two cohorts of students 
through their SCC experiences/ and the results are, I think, quite revealing. 

It is important to emphasize thj?,t the two cohorts together are much more 
valuable than each of them taken separately. Not only can we be a. good deal more 
confident that we are measuring something real when the two studies give similar! 
rcsuii but we are also able to clearly see the effects of changes in the cbmpositipn of 
the student body oyer time. As I pointed out at our last meeting, the data are in 
many respects most valuable for y/hat thdy ctow'r show. They do not, for example, 
show considerable fluctuations in the retention rates for particular student popula- 
tions or programs. This imp^iies that rhs' way, we have brpj^en down the student*' 
population into analytical groups appropriate, and that we arq dealing with 
relatively stable patterns of student behavior. The data also do not show that SCC 
has "a major retention problem for traditional student populations— full-time, 
younger, day, degree-seeking students. Indeed, the '-completion" rates shown and " 



the tcrm-to-tcrm retention rates achieved for this body of students arc corfiparable 
to those typical of most community colleges nationwide. In fact, because this 
population of students constitutes an'unusually large component of SCC's enroll- 
"ment, overall retention rates are quite good comparatively. . 

Mbst importantly, perhaps, the data effectively confirm previous perceptions 
about retention at SCC and the populations in which effective retention occurs. 
Furthermore, the analysis indicates the degree to which changes in overall reten- . 
tion are primarily due to changes in the composition of the student body, and that 
new retention policies will probably thus result in relatively marginal comparative 
improvements in overall retention for specific, carefully targeted bodies of 
students. One role of the data collected, therefore, is to help define these target 
groups and to help anticipate what kinds of improvements can reasonably bt 
expected as a result of new policies £tnd procedures. 

Table 1 presents summary results for both cohorts. A similar table breaking 
down results 'by program has been supplied to the Deans for their information. 
Definitions of major categories afe as follows: 

"Completer"— A student. is placed in this category if he/she has completed 
the degree or certificate in wfiich he or she first enrolled. 
• "Still Attending"— A student is placed in this category if he/she is enrolled 
at see in.awj; capacity for six semesters after first enroUing. 
"Fall '198 - Only"— A student is placed in this category if he/she is enrolled* 
' only for the first semester of attendance and never returned to SCC in any 
of the five semesters studied. 

These categories are, of course, not mutually exclusive., A student could 
"complete" a short program and still be a "Fall Only" attender. A student could 
"complete" a program'and still be enrolled subsequent to completion by taking 
courses not related to his or her original program. The point of the categories is to <, 
highlight general patterns rather than to provide a precise enrollment history for 

each student. „ 

Comparison of the demo|raphic profiles of the Fall 1980 and Fall 1-981' 
entering Cohorts reveals that the later entering group contained a somewhat higher 
proportion of traditional students-younger, full-time, enrolling for transfer work 
or for explicit job preparation. These differences, and the somewhat smaller size of 
the Fall 1981 cohort, are important because they are largely responsible for the dif-^ 
ferences in retention rates experienced by the two cohorts as a whole. 

"For example, the entire 1980 cohort experienced apprbximately 3-5% greater 
"attritionl' than its 1981 counterpart. That is, 54.6% of the Fall 1980 entering 
. group attended only the first semester, and 51.4% of the Fall 1981 group attended 
only the first semester. Similarly, 21% of the 1981. group as a whole was still attend- 
ing SCC five semesters later, and 17.9% of the 1980 group did so. Looking at the 



■ TABLE E.l 

* 

RimjNTioN 01' Fall 1980 and Fall 1981 Coiiok ts 





N 




Compleieni 


Still AuendlnK 


Fall 


Only 




I960 


1961 


1980 


1981 


1080 


1081 


1980 


1981 


I O T AL 


141 1 


1279 


11 Ant 
1 1.470 


13.9% 


17.9vc 


) 21.0yo 


54.6% 


51.4% 


Male , 


560 


" 528 


14.3 


17.4 


21.4 


27.7 


52.7 


46.0^ ' 


Femnlc 


851 


751 


9.5 


11.5 ■ 


■ 15.6 


16.4 


55.9" 


55.3, 


Under 20 


600 


681 


19.0 . 


21.1 


30.4 


30.5 


40. 'r 


*36.1 


Over 20 ' 


811 .. 


598 


5.8 


5.7 


8.7 


10.2 


65.4 


68,9 


While 


1340 ' 


1212 


11.6 


14.4 


17'.9 


21.8 






Non \f/h\tQ 


71 

** 


67 


7.1 




18.6 


7.5 


52.9 


35.0 


. Jersey 


753 


630 


1 l.U 


17.9 


22.0 


26.7 


48.6 


46.8 


Wnitcomb 


321 


357 


4.7 


4.2 


0 A 

8,4 


8.7 


63.2 


61.1 


Altier 


157 


• 105 


10.8 


10.5 


yen 

. 15.9 


21.9 


60.5 


54.3 


Nicholson 


1 17 


117 


15.4 


10.3 


6.0 


18.8 


69.2 


53.0 


Other 


63 , 


70 . 


44.3 


38.6 ' 


. 44.3 


35.7 


41.0.. 


37.1 . 


Transfer 


208 


188 


y A A 

14.4 


15.1 


' 34.6 


39.4" 


« 

30.3 


24.5 


Occupational 


455 


,347 


28.6 


39.2 


23.3 


33.1 


46,i3 


32.6 


Other 


748 


744 


■ 0.1 


1.1 


10.0 


.10.8 


66.3 


^67.1 


Prepare for Job 


432 


440. 


23.2 


25.0 . 


24.8 


30.2 


40.5 


35.0 


Improve Skills 


116 


84 


13.8 


17.9 


4.3 


8.3 


75.9 


73.8 


* Explore Courses \ 


26 


27 


11.5 


3.7 


34.6 


18.5 


" 46.2 


44.4 


Transfer Work 


198 


-248 . 


13.6 


16.9 


32.3 


34.3 


' 40.9 


32.3 


Remedial 


'301 


162 


0.3 


0.6 ^ 


15.3 




57.8 


62.3 


Personal/Self Dev. 


315 


294 


1.0 


2.7 , 


'.5.7 


7.8 


71.1 


79.3/ 


Other 


23 


24 


8.7 


4.2 


17.4 


4.2 


65.2 


66.V 


FuU-tinrie 


391 , 


•445 


33.8 


32.4- 


41.2 


42.7 


21.5 


18.0 


Part-tifiie 


' 1020 


834 


2.8 


4.1 


9.0 


9.5. 


.67.4 


69.3 



difFerences for particular demographic groups, however, very few. differences be- 
tween 198 1 and 1982 are notable. Percentages ''still attending" in the full-time and 
under- 20 groups, for example, are quite similar. 

^This leads to the conclusion that the enrollment behavior of particular 
subgroups of students is fairly stable over time, and that differenced in overall reten- 
. tioh rates are primarily diie^o difFerences in the proportion each subgroup, cc i- 
stitutes of the student population as a whole. If stability of subgi cup behavior is 
- assumed to hdld over time, it is possible to approximate the "natural" reteation rate 
for any given sec entering class given its demographic composition. This 
"natural" estimated rate could then be compared to actual rates obtained in order to 
assess the effectiveness of particular retention strategies that SCC might put in 
place. ^ ■ V. ' ' • ■ 



2. Reasons for LcUving SCCs . 

In nddition to tracking two student cohorts, wc surveyed students withdrawing 
from sec over the past two years. "As you will' recall, surveys were sent to -all 
students not returning to SCC after two terms of absence. The survey instrument 
we used was the NCHEMS/CoUege Board SOIS Former-Student Questionnaire, 
and we received a 46% return after two mailings. Detailed results oftlie survey can 
be supplied upon request. 

Table 2 summarizes salient points of this survey. Five peneral reasons fpr 
withdrawal are broken down by demographic group in this table. I would like to 
particularly draw your attention to the following; . 

— Only a bitover a third, of these withdrawing were dissatisfied with the 
academic envii-onment we provided. Almost as many were leaving for 
the more" positive reasons of having achieved a goal or accepted a job. 
Approximately a quarter were leaving because of a personal or finan- 
cial reason. ' . ' 

— Men were more likely to be leaving for a job; women were more likely 
to be leaving for a personal or financial reason. 

<f '— Younger students were considerably more likely to be leavinjg for 
"positive" reasons such as goal fulfillment or employment. 

TABLE E.2 

PERCENT Responding with reason, for Withdrawal 





Achieved 
Academic Goals 


Dissatisfied 
with Academic 
' Performance 


Achieved 
Personal Goals 


Accepted 
a Job 


Personal or 
Financial 
Rci^son 


TOTAL 


32 


' 37 


35 


18 


24 


Male 
Female 


30. 

34 : 


39 
35 


36 
35 


27 . 
8 


* 16 , 
33 


Under 20 
Over 20 


36 
.27 


.29 
46 


-41 

29, . 


27 
11 


16 
31 


White 
Non White 


32 

31 


37 


35 
34 


18 
19 


24 
24 


Jersey 

Whitcomb 

Altier 

Nicholson 

Other 


30 
33 

3i 


38 
36 

■ 34 

■ 39 

36 .. . 


35 
38 
29 

34 . 
37 , 


19 
18 
^16 
21 
• 18 


2^3. 
• 24 
23 
27 
21 


Transfer 

Occupational 

Other 


. 41 " 
24 ' 
31 


39 ■ 
.34 
36 


35 

' „ 36 ■ 
.34 


9. . 
41 

,16 


" 21 , 
19 

■ . 32 . 



— No dilTcrcnccs wcrciipparcnt by county of residence or race in terms of 
reasons for withdrawal/ ' ^ v . * 

— KcasonsVor withdrawal were consistent across progranis-roccupa- 
tional students more frequently left for jobs, while transfer students 
reported academic goal fulfillment to be a major reason for leaving. 

These responses reinforcfe our suspicion that ditTerei)t kinds of students are 
withdrawing from SCC for different reasons. They also allow us to put into 
perspective the total attrition figuies jvohave obtained from the coljort studies. 
Many of our students are withdrawing for **positive" reasons or for reasoris about 
which we can do little. This makes it all the more important that we carefully target 
our retention efibrts on those issues and those student populations we cm/ afiect 

.positively. ' a* y 

' (I - * . 

3, Some Specific Retention Populations: 

my memo of December 5 on.the structure of enrollment at SCQ I suggested that 
retention discussions be undertaken in terms of five quite distinct student popula- 
tions: ' ' 

— Full-time, day transfer program students 

— Full-time, day occupational program students 

— Part-time, day students seeking degrqps or c^^rtiflcates ♦ 

— Part-time, evening students seeking degrees or'certificates 
' — Non-program students 

Together, these five types have constituted 90-95% of SCC's enrollment in a given 
term, and furthermore, the proportions of thctotal enrollment that each represents 
have remained fairly constant over time. 

/ Because these five student populations are quite distinct, it is useful to consider 
them independently. The charts that , follow are intended to guide discussion by 
summarizing on a single piece of paper what we currently know about each popula- 
tion, what questions this knowledge peems to raise, and what kinds of recommen- 
dations seem fruitful to pursue. These charts shouldjbe added to and modified 
through Committee discussion. They are intended only as a starting place for 
making recommendations. „ . 

I look forward to meeting with the' Committee and to discussing the implica- 
tions of these findings in more detail. ' . 
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Retention Population Issue Summni^— 1 

Student Population: '. Pull-iime Dav Transfer 

A. Retention Rates 

Full 1980 Cohort Full 1 )81 Cohort 

"Completers" . ' 20'. 1% " 24.1% 

"Still Attending" , 43.8% " ' 45.4% 

"First Semester Only" ' 20.8% " 17.7% 

B. Important Demographic Characteristics 
55-60% male' 

85-90% under 20 years old 
50-55% from Jersey County . 
1.5-25% "to prepare for Job or career" . 

C. Reasons for Leaving S^/;C (Summary Results) •• 

47% Achieved acade^^ic goals 
7% Accepted a job/' ' \ . 

39% Dissatisfied with academic performance 

• / ^ f ■ ' , s- . 

D. Retention Objeptives/Approaches _ 

—Increase proportion trans'ferring to senior institutions having ^ 
completed 'AA/A^ degree 

—Minimize number of students leaving for "traditional" academic 
or social reasons throughout the enrollment period 

E. Sum»«ry " • - ' 

• This is SCO's "traditional" college student population. Although it 
•constitutes only about 10% of total headcount, itgenei;|tesa high pro- 
, / portion of total FTE. Preventing owe student from this category from 
I / leaving the institution is the eljuivalent in SOH terpis of saving three 
part-time students. These stucifents are likely to respond to traditional 
retention apptoaches^ea'rly warning, improved advisement, greater 
' levels of information involvement with •faculty, and other programs 
aimed at increasing total involvement with the institution. 
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Student Population: Full-time Day Occupational 
--- A. Retention Rates 



Fall 1980 Cohort EalUQRI Cohort- 



"Completers" ,51.3% " 45.1% 

"Still Attending" * 42. 1% . 42.9% 

"First Semester Only" 17.8% 15.5% 

B. Important Demographic Characteristics 
45-50% male 

75-80% under 20 years old , 

55-60% from Jersey County 

90-95% "to prepare fur job or career"^^ 

C. Reasons for Leaving SGC (Summary Results) 

43% Accepted a job 
V 24% Achieve^^ 
. 34% Dissatisfied with ac^^^^ 

Retention Objectives/ Approaches 

—Maintain current high-retention curricula unchanged 

: „-^Ih current low-reteritio are 
leaving for enipioyment in field or for other reasons 

-f-Minimize number of students in large programs leaving for 
"traditional" academic or social reasons ' ~ — ~— 



E. Summary 

This is alsoa "traditional" population, biit somewhat different from 
the transfer population . piffererices in retention rates among par- 
ticular programs are re 
will have to be ex^ 
clearly no problem^ and caf e; s 

, grams do not distiirb a good thing. In other curricula, college-wide 
progranis such; as academic m 

. both cases, it should be determined more effectively by ^^p 

many students are leaving because they have successfully found 
employment. 
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'^30:(SZy;r Retenti6n;PopulatibnIssue 'Nummary— 3, • ^ 

: : ' '>,iHAnf Pnpiilatinn- Part-time Dav Prosram . 

» A; Retention Rates * 

' •" ' Fall 1980 Cohort ' . Fall 1981 Cohort 

"Completers" 6^6%^ 28,4% 

"Still Attending" 9.0% ' . 16.5% 

"First Semester Only" " 62.0% 59.6% 

"B. Important Demographic Characteristics 

' 75-85% male ; ^ : 

/ : 55-60% under 20 years old 
. 55-60% from Jersey 

50-55% "to prepare for job or career" 

C/ Reasons for Leaving sec (Summa^^^ 

29% Achieved academic goals 
, 14%. Accepted a job^^^^^^^^^^^^^^^ . .^ 
34% Personal or financial r 
38% DissatisfiedNvith academic, performance ■ 

' ' ' - -'-^ ■ ' ' 

D. Retention Objectives/ Approaches , , 

-Determine if students are leaving to seek employment or because : - 
family/financial pressures have become excessive 

—Determine seriousness of job pr?:paration intention. 

— . ._jt.^^iy^f,yskal^istieaLhatnQTS..to^^ 

or family responsibility) ' 

— Remove ps^/cAo^zcaAbarriers to attendance (e.g., feelings of 
inferiority on returning to school) 

E. Summary - — ' 

This is a very "non-traditional" population. Attrition.in this group is 
probably more due to lack of psychological support or the existence of 
barriers to attendance than due.to^academic failure. Ways to identify^ 
• ' - problems in this group at an early point are particularly important as;^ 
' they will not stick around to be noticed. 
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Retention Population Issue Summary— 4 



Student Population: Part-time Evening Program 
A. Retention Rates • 



— Fall 1980 Cohort Fall 198rCohort 

"Completers" " 12:2% 6.3%^ 

"Still Attending" 9.5% 16.7% 

"First Semester Only" 70.1% : 60.4% 

B. Important Demographic. Characteristics 
80-85% under 20 years old 

45-50% from Jersey County • 
35-40% "to prepare for job or career" . 

.C. Reasons for Leaving sec (Summary Results) 

49% Dissatisfied with academic performance 
37% Personal or financial reason 
. 9% , Accepted a job ^ 
24% Achieved academic goals . . ^ ' 

^ Dr Ret en tion Obj ectives/ Approaches "■■ 

'^Deter mine if students are leaving to seek employment or because 
. f^^ been excessiyc; 

' * ^Remove physical/logis^^ 

travel problems, etc.) ; , 

E. Summary . . ; 

This is probably a mixed population: Attrition will probably be 
lowest among those attending for career upgrade purposes, in occupa- 
tional programs; and attrition here will probably be th^ result of 
factors such as cost, lack of time, or job conflict. Attrition will be 

^rnhlghest^amd^ 

career change or earning a transfer degree. Here attrition will more 
likely be a psychological phf^nomenon. Early determination by. 
faculty in evening courses of student intent seems a promising first 
step here. • . . • . 
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Retention Population Issue Summary^ 



Student Population: Non-Pro^am Students 

A. Retention Rates 

Fall 1980 Cohort Fdl 1981 Cohort 

"Completers" 0.1%. 1.1% 

"Still AttendingV 10.0% 10^% 

"First Semester Only" ^66.3% / 67.1% 

B. Important Demographic Characteristics 

■• _^ 1 ■ ■ , ■ ■ . -. . , 

• 60-65% female ; 

' 65-70% over 20 years old . 

45-50% in Jersey County v - 

25-30% "to' remedy skills deficiency" 
35-40% "personal self-development" 

C. Reasons for Leaving sec (Surnmary Results) . 

43% Achieved academic goals 

31% Personal, or financial reasons 

39% Dissatisfied with academic performance 

D; Retention Obj'ectives/Apprp 

^ -^Encourage students: to enroll . programs, if appropriate, on a 
\''";-"'::-"pah-timie-basis'- v;-^^ 

—Develop: permanent "personal/self-development" 
older students who return to. the College for further instruction 

E. Summary 

Although this group comprises about half of SCO's headcount enroll- 
ment, it is difficult to talk meaningfully about attrition at alL here, 
• ' given the diversity in original intentions. This group should not be a 
-,primary target of retention efrorts:iEfrorts^^ 
_ program students within this group at an early point should be en- 
' couraged, however ■ . . . : ; : ■ , . . . 
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